Try not to think too much!! It makes you crazy....I speak from my own crazy soapbox and experience.
Some ideas.....puzzles. Bowling. Is there a family friendly restaurant? Walking, tennis, and believe it or not, Wii. I would think of something where you can interact and talk if one of them feels they need to. Plus something H can be jealous he's not a part of. So let H know whatever new hobby for the family you decide on....and really, it could be all of the above, so that if he wants to join in, that works for all of you.
Getting away sometimes.....it's exactly what the DB doctor ordered.