Those words sting like nothing else, but please don't listen to anything he says.
The WAS thought process always amazes me. When they say they're not leaving the kids, but are leaving you...here's a newsflash, they are leaving everything and everyone, but they don't want to hear that.
I think that when they feel threatened and their decision is being questioned, they get more defensive and more hurtful with their words.
I'm sorry you had to deal with this last night. Enjoy your trip with the little munchkins and don't think about your H too much.