Try looking at it in another way. You are not hurting him or making him feel bad, he is hurting himself by the (wrong) path that he has chosen.
Sweetheart, if you don't let him feel these honest and deserved feelings for his actions he will not have a reason to change them.
There are consequences for his leaving you and being with another woman, as in he might not get to talk to you as long as he would like, he might not know where you are all of the time etc. If you keep intercepting the consequences and protecting him from them, he will have no reason to want to change.
Does that make any sense?
Most of us are about as happy as we make up our minds to be.
