Thanks CVA, that's certainly one way to put it. I'm having a hard time distinguishing between setting a boundary and an ultimatum, I guess.
To be honest, if H were a friend asking me for advice, I'd tell him, look, you clearly want to be free to pursue other people, and you'll need a space to do that. It's not cool bringing women to your wife and kids' home.
Of course I'm not and he's not, so that's moot.
CVA, for god's sake, man, keep your eyes on the road!