Nope nope nope not broken and nothing wrong with you.
But maybe not ready for what you "think" you want. Maybe the brief encounters are totally and completely fine for now and you don't need to date.
It sounds to me like you're trying to follow some kind of rules about how you should be dating or how you should act on a date. Or that you should be dating at all because you've served H. I vote you drop those expectations of yourself. If you don't want to date, don't date. If you want to date but don't want to stay for coffee in the morning, don't stay for coffee. But do it without regret or beating yourself up over it. Or apologizing.
I'm in yet another new place after my D which is why I have this perspective. I'm so happy being single right now. Not in a "yay girl power I don't need anyone else" kind of way but just in a "I honestly have very little interest in the BS" kind of way. I think it's authentic - I don't think it's fear or some other overwhelming emotion driving me. I think I just am embracing the fact that I don't have to follow the rules (introduction> date> date> relationship>sex). If other people expect me to date that's on them. I'm writing the script from now on.
We don't have to stay just because someone has nice toiletries and plants (although omg I laughed at the toiletries being something you noticed. I probably would too). You can have a nice quick connection and let it dissipate in the morning and not feel guilt over that.
I guess what I'm saying is I know you're still under quite a bit of stress with your way forward. I hope you take the stress of your own expectations of yourself off the table and just do whatever you want to do.