If your H is anything like mine (in good ways LOL), I think he was just seeing that you were enjoying yourself and told you it was ok to stay on. Plus, in the primitive man sort of way, he is probably enjoying sitting on the couch, making all sorts of bodily noises and not having to say "excuse me", scratching himself, and eating what he wants. Doesn't mean he doesn't miss you.
One thing (don't kill me) is I think you need to stop offering to do things with him, stop being available to him in that way. I am not talking about sex, because that's different. I am talking about possibly sounding 'needy' with the "I would have wanted to go" talk. Make some plans for yourself, have fun, and try to wait to see if H invites you to do things next time.
