I don't think it's any different for men than for women. I think most people prefer being second. It's just one of those things reasonable people negotiate in a reasonable way in the context of an encounter or a series of encounters. It sounds like your SO is being unreasonable and rude.
"Tell me, what is it you plan to do with your one wild and precious life?" - Mary Oliver