You know, LL, it just seems like your H is fearful. As long as he keeps his feelings at bay, doesn't engage you in confrontation, the junk inside of him doesn't surface. I simply believe (IMHO), it's a defense mechanism.
What ever happened to the counseling appointments you guys started some time back?