It is a tough answer because if he is having sex with the OW and with you then your sleeping with everyone the OW has slept with. Your health is at risk.
Is that OK?
Are you ok with sleeping with someone that is sleeping with someone else. Sorry to say you won't win in a sex-off with an OW.
