I agree with what Abbey said. Don't let him put you in the same category with ow. You're special, ow is, well whatever.
That was some exchange with your H you had. I think it truly shocked him, and I also think he expected you to say yes and run back to him. I hope he IS worried. It will do him good to worry! And telling him to leave your home when he was started to make himself at home there, was a good move.

Now that you have smacked him with your statement, he will probably start coming around more. It will be interesting to see what tactics he will use to try to pull you back in.

You are strong enough to go through this, and keep your sanity doing it.

vc