I think your H could not have given a more perfect answer or handled the deal with the cookbooks any better than what he did. However, I don't think any PJ's would be worth the risk of appearing to be insensitive to your H's feelings. He may wonder why you were hanging on to some PJ's another man gave you. And, seeing you wear them might not set as well as knowing you have cookbooks setting on a shelf. Can't look at PJ's with the same eyes as you do cookbooks....know what I mean? Even though your H sounds fantastic, it just seems inappropriate....even if they aren't sexy. JMHO.
It is not about what you feel should work in your M. It is about doing the work that gets the right results. Do what works!