If you are waiting for your h to tell you what he thinks about the situation right now, I hate to say it...but your expectations are way too high for him at this time. Take a look around him, i.e., he's got a new fort to live in, he's put up a car canopy and is now working on toys for now only him to enjoy, but his son as well. I've always stated that actions speak louder than words and right now, his actions are indicating that he is enjoying his life as it is right now and also enjoying the freedom to come and go not only at his "fort" but also when it comes to you and your home. Why would he change any of it when he can have the best of both worlds or as I say once in a while, a toe in both ponds.
The only one that I see getting frustrated w/this arrangement is you. It's time to do some 180's and try not to be so readily available to him all of the time. He can't miss you if you are still right there, front and center.
Trust me, you won't send him a signal that it's over if you slowly disengage from the "family" activities w/him. In fact, it just might make him more curious and begin doing something different. Don't you remember how he reacted when he thought you had a party and someone staying w/you? He got miffed about it. He wants you to stay right where he left you and no, he doesn't want you to date or get involved w/anyone else...that was very evident the last time he got miffed w/"just a friend" staying over.
Mleigh...time to do some 180s. Don't worry about his feelings...he'll get over it. After all, he's certainly not worried about yours at the moment.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.