No need to be there for the game. If he asks you to join him (which I suspect he will eventually), tell him you have plans, but you'll try to come in for the end.
I know what you mean about wanting H happy. I can honestly say now that I want H happy, but if he is with another woman, just a teeny bit happy. LOL!!!