I’ve got to agree with Chrissy. If I were in your H’s place, getting all worked up and things going good, then you get up and leave, well, I’d have to think WTF. In my mind, I’d be wondering why you didn’t take a bath before starting something.
I can see him feeling some level of rejection over this, possibly a little anger. He may have lost desire, at that moment, but the fire in his loins didn’t just vaporize. You get a man worked up enough and he eventually needs the release. Trying to go to sleep without this release is tough and frustrating. So my guess is he decided to get over his hurt and initiated with you so he could get to sleep. At that point he wasn’t interested in pleasing you, just himself.