Maybe it was hesitation in your eyes? Fear of letting him back in? Either way, I think he was probably feeling guilty and it just hit him. He is probably also overwhelmed by having to make things up to you that he is thinking "I tried, it didn't work" and is upset about that.
The dinner/reservation thing happened, those things happen, but it just happened at the wrong time, because you were expecting nothing but the best from H. You wanted more effort.
Resentment is like a handful of snakes. If you keep them close to you, by your heart, they will just bite and bite and bite. It doesn't hurt anyone but us (the ones holding the snakes), not even the person in front of us. So, we have to try to let go of the snakes, to stop hurting us. When we stop hurting, we can focus on what's in front of us.