LE-you can be a daily presence via phone, email, whatever. As they get older, and start to develop their own lives, that may be all it is even if you are in the house. The key is to really make the most of the time together, let them know they can always count on you, call you, anytime, day or night for any reason. Even if it something as stupid as "I just saw a commercial on the TV for something I want" That is the kind of Dad you need to be, regardless of anything else in your life. It is the kind of parents we all deserve but so few get.
That was actually something I grappled with when I went back to work. I was a SAHM for quite a few years. And yes I still see S daily, we do live together, but sometimes it is only for a few minutes. As one is running in and the other out. If you D, you and W can agree that you can visit whenever they or you feel like it not just on set visitation schedule.
As far as your dream house, if you want it you will do it. Right after WW2, my grandfather built a house for my grandmother. Economy not good, took a few years cuz he actually did it himself, but he wanted to do and and he made it possible.
If you focus on the past, you ruin the future. You can only live for today.