Your feelings are yours and absolutely you are entitled to them, the only thing you're not entitled to is to dump those feelings on someone else. And you shouldn't act just on your feelings alone, that's what our Hs did and look what a horrible mess they caused! I can see how much your H is frightened to lose you, I have the same thing going on with my H (except mine just vaguely threatens in the direction of D for the moment). It is utterly perplexing isn't it?
Your job sounds great, a big part of your GAL. It's not easy being a SAHM because it can be so thankless and unfulfilling, so I'm glad you have your job to boost your self-esteem. Next stop: meeting people in the next town?