I get your drift, and I can see how it would be a little harder for a woman to take that rejection, seeing as how society seems to teach us that "ALL MEN" want sex SO much, that you'd have to be totally undesireable for a man to reject you.
But I can tell you from my own experiences as well as several months of reading my HD soul brothers on this bulletin board, WE DO HURT and take the rejection personally.
Speaking for myself, I cannot STAND "mercy sex," and it is the single main reason behind my self-imposed abstinence for the past few years. As I told my wife once, "People go where they are invited," and I simply NEVER got invited anymore, so I gave up. It simply hurt too much to face that rejection.
If I had to put my finger on it, tho, I don't think I question my LOOKS at that point (I'm above-average looking, always had PLENTY of GFs before marriage, and still get a lot of attention); I may very definitely question my SEXINESS, tho.