Wasn't he also often rude to you? That's a problem on par with no sex. Imo.