I presume your "love, hugs and kisses" include all sorts of bedroom proclivities. So H is turning down all this and pulling away and turning his head, pushing you away, etc?
That sort of rejection is the worst. People think because its "your spouse", that the rejection does not matter. If that is the only place you get that feedback from ,that rejection will tear you down and heavily reduce your esteem.
Good luck in getting him to come around. As always the best way is to get him to want to do it without being pressured.