Sure, that's terrible if someone is like that in a marriage. You deal with it by giving an ultimatum (marriage counseling or I'm out) then by exiting the marriage if it can't be saved.

What you DON'T do is use that as an excuse to have an affair.