Ohhhhh man... I can sense that "things" are building up to the point where H is gonna blow up at you in a not-so-nice way. Are you ready to ask him to leave for a night when he's enraged? Can you make it through a night without him in bed or in the house, without calling him and wanting to talk it out?
I hope that I'm wrong. I hope that H grows up, realizes that he has a dedicated W who wants to enjoy life fully instead of just enjoying her kids and her music, and opens up to you. I just... read the things that you're writing about him and see my W and I many years ago, before kids, before I "grew up" and became a H and lover instead of just a BF and "date."