Well you're doing well - with the same advice you gave to me. You are asking him to be straight with you about if he wants you around or not, and you are respecting him when he says he needs space.
Now you do what you advised me to - you get really busy when he's at the event. You have things to do for yourself, anyhow. H will see that you aren't sitting around p.o.ed that you weren't invited and that frankly it works out better for you. This takes the pressure off.