Maybe next time he feels like sharing his feelings do a 180 here. Instead of withdrawing, get closer, act as if and maybe even give it up without having your talking needs met. In one of Michele's articles she writes this maybe it could work for you.
Quote: 8. Tip over the first domino Here’s the Catch-22. Women need to feel close to their partners- spend time together, have meaningful communication- in order to desire sex. Men need to feel close to their partners physically in order to put energy into being together and communicating. Sex-starved men feel rejected, hurt , angry and they withdraw emotionally. They watch inordinate amounts of t.v., leave their pop cans in the family room, and appear to forget they have any responsibilities at all. Communication -starved women feel depressed, short-changed and resentful. They nag, criticize and shut the door on intimacy. In short, when men tune out, women turn off. And, when women turn off....men tune out. What’s a woman to do?
* It takes one to tango. Remember that when one person changes, the relationship changes. * Experiment by tipping over the first domino- show more affection and interest in sex- even if you’re not extremely pleased with him at the moment or 100%in the mood. * Watch the miraculous results. When your partner feels happier because he feels close to you physically, he will become putty in your hands. I’ve seen chronic couch potatoes transform overnight into enthusiastic conversationalists, laundry doers, grass mowers, car poolers, and Hallmark card buyers . It’s worth a shot
I just think a nudge in the right direction may have your H's anxiety about staying over and feeling bad helped. I think you are the one to help do this. I know it is his issues and you can't fix them. You can give him an avenue to feel comfortable to kick them. JMHO.