I think narcissistic hits the nail on the head. So, it's fine for him to have someone else, but you couldn't even consider dating without being a whore? Wow! Double standard.
I know you probably want to feel the connection of sex, but I think you did the right thing. He should be the one fighting to keep you, not expecting you to be his toy and available whenever he deems to grace you with his presence. You're better than that. Maybe he will get off the snide if he fears he'll lose you. Maybe he isn't worth it anyway? If he moved out of OW house and back to yours with his promises, could you trust him? Every time he went to "a game" or on some errand, would it be possible to trust that he wasn't getting some on the side from the OW?
Me
In the end, it's not the years in your life that count. It's the life in your years. Abraham Lincoln
It is hard to fail, but it is worse never to have tried to succeed. Theodore Roosevelt