Don't worry about the sex. IT's best to keep all lines of communication open, and sex is a form of communication. But if you are being emotionally hurt by it, then you should not do it. So it is totally up to you. He's your H, she's the one who should feel guilty.
