I really think be just doesnt know how to deal with his emotions. I think he feels them alot stronger than others because he is a very emotional person.
You think you think you think. If you don't KNOW his emotions then this is a huge problem in your marriage. You cannot assume you know what he's feeling, because I promise, you're not even guessing in the ballpark. I'm not sure he's ready for it now, but the two of you could definitely benefit from Retrouvaille. It'll give you tools for exploring each other's feelings and emotions.