Have you told him that you're not willing to live in an open marriage?
ARE you willing to live in an open marriage?
If you *are* still having sex with him, I hope to God that you are using protection. Please be careful, Palau -- your health is far more important than your marriage.