If he is nervous, and doesn't want to jump right into sex, is there some kind of buffer that you might both enjoy, one that doesn't distract from sex altogether?
For instance, what about snuggling up together and eating some fresh-dipped chocolate covered strawberries, or a backrub? My wife likes me to read short stories to her. Or light some candles or a fire or whatever and tell him you'd like to enjoy being together without the talk. All of these things can be done fully clothed.
You get the idea - if he needs to slow down, take the pressure off, and refocus gradually, but do it with activities that are pleasant for both of you.
This may or may not be helpful. It really is hard for me to put myself in his shoes, I've never had any reason to want to stay away from sex and intimacy, though I've had more than my share of opportunity to do so.