I want him to leave. I can't just sit back and pretend everything is ok. If he's comfortable with how things are now...me doing everything at home, being a doormat, and H finding emotional support in OW. It can go on for a long time. H needs reality to hit him. Once he's gone, he can figure stuff out, if that is really what he wants. But as long as he's at home, he'll get too comfortable with everything.
It also makes complete sense with his interaction (or the lack thereof) with S4. He feels guilty. The reason why H "confessed" the first time was because he thought that S4 meant the world to him and he didn't want to hurt him. H used to be a great, devoted father. I cannot say the same now, and I know it is because of his guilt.