OG: Where is it written that he gets to dictate all the terms of this? See a lawyer and ask questions. I think a lot of them will give you a free consult.
Most of the stuff I read said that for DB purposes, it is better if the spouses stay together in the house. I understand the logic of that (sort of). Remember the junk May had to listen to from her H. It's quite similar to what you are hearing and she still managed to turn it around. Remember what they say here, "believe nothing you hear and only half of what you see." You'd do well to keep that in mind. Is there a spare room/basement you can move him into?
Michelle talks about in house separations in those videos. It can be done. Steve85, the guy here with all the answers did it too. You might ping him and ask how they managed it.
Until you understand your rights and what is possible for you should this happen, you're flying blind. He is in LaLa land and isn't the one you should be discussing this with.