It is a tough answer because if he is having sex with the OW and with you then your sleeping with everyone the OW has slept with.
Your health is at risk.

Is that OK?

Me-70, D37,S36