I am one who doesn't think it is always better to have them in the house. Your case is one where I think it would be better for him to be out. I think you are stuck until he leave. He needs to go for him, but also to give you the room to work on you without worrying about what he is thinking.
