For heaven's sake that is just ridiculous. I guess it is no more ridiculous than when I would turn down xH for sex and he would browbeat me about how unattractive I was so that I was left to have to initiate the next time to prove my attractiveness - to him, to me - whoever????
When your own self respect becomes the most important thing that is when it is time to leave a R. I think you will now recognize that tipping point more quickly and you won't be so afraid of it.