His feeling is that we have always had this problem (roughly 10 years) and I've done nothing to fix it while he's tried alternate solutions I am not saying my situation is similar to yours but but as a man that has to bring all the heat to the romance/sex and experiencing many put-downs, I can relate to your H saying he said he didn't even want to have sex with me.
Sometimes for me, it isn't that I don't want to have sex, it's I wonder if it is more work, puts me in a position of being the recipient of more put-downs, than the good I think it brings to me and my W.
When is the right time to have sex after such a drought? Try to be his friend first. Having sex just to keep him might smells like second best to him and gets into the "too little-too late" problem area.
If you think it is all about a guy getting off-wrong! I will give you some fast information. For me it isn't only about sex. I want emotional connection too.
What are your beliefs about what you think sex is to guys?