Just to make you feel better (or at least not alone), this summer (July), I checked H's phone moments (within minutes) of us ML and he had called OW. That was the last time we ML until December.

I really think you are making the right decision about not ML at the moment, but next time H isn't drinking, I think you need to explain why to him.