Honey, keep in mind he isn't giving up his W totally, only one aspect of the R (ok, a relatively minor one in his eyes, a major one in yours). I'm sure if the question was put in such a way that he was completely isolated from you the answer would be a "Honey all the way, baby". Keeping with the sweets, Giving up the nookie is like giving up only pastries (which perhaps is not even his favorite sweet) for lent, but he'd still be free to indulge in cookies and candy. He's still got a beautiful and engaging W taking care of him and willing to discuss his favorite subjects. What more could a man want? KWIM?
Anyway, maybe you should discuss with him how his answer made you feel. Just discuss your feelings. Don't vent on him, you want to get to a place where you can both open up to each other more. I know he doesn't want to hurt you, and I suspect he's wondering what he did wrong.
--GGB, wishing he was better at listening to his own advice