Yes it must be hard for your h to share his emotions with you if it freaks you out. He wants you to be able to handle it not over burden you. He's considering how you feel and that is great.
When he comes to you with how he feels, what is going through your mind? Are taking it as a personal attack? Are you forming solutions in your head?
OK, I'm not familiar with your sitch. In short, why did you push him away? Why did you berate him when he complimented you? If it was an a, is he open to being accountable to you? Have you told him you are willing to trust him but need a, b, and c from him to help you to do that?