that sounds really frustrating. At least however he didn't do something even stupider like ask you to stay and then ask you to leave, or ask you to stay and then act really confused. I know you have EVERY REASON to be frustrated and mad and SHOW it but it might help your Sitch more if you play it cool when this stuff happens and don't show it... if he doesn't feel pressure to have sleepovers he will probably be more interested in spending time with you.
Congratulations, still!!! You basically just went on a date with H!!!!!