((((((((courts))))))))
I think CG has it right. Tell him he can come back, with no contact with OW. That you will not continue to live the way you are. Don't tell him what the consequences are, just tell him what you won't tolerate.

I don't know what his reaction will be, but if you make it an ultimatum, he will pull away for sure.