H has started an affair 2

[mvgfwd2]

I think that is perfectly acceptable. Just make it clear what you need to get there. Like proof the A is over and re-commitment to work on the M (these would be mine, you need to pick your boundary). I would think H could accept your need to be in an exclusive relationship (it's the foundation of marriage for god's sake!!).