I need to refrain my wording as above it is not clearly explained.
1st difficulty: H always wants to stay in the house when he comes over. His view is that it is also his house and I can't refuse him to sleep here, in the spare bedroom of course.
2nd difficulty: I made a clear boundary that if he was coming over to the house, I would not be here. Since he wanted a divorce, we will not be living under one roof anymore.
And to be honest, I don't want to be in the house with him. He kicks on drama and I'm the target (that's why he always wants to stay in the house) so it will actually be worse for the children. I don't want to put them through that again...