It seems like you and I have some common themes. I'm a little older than you but my hubby's the same age as yours and he walked out too, only it was a lot longer ago! But I'm still actively DB-ing and keeping the faith!
Anyway, though my H hasn't said it in so many words, I know his perception that my family hates him for doing this to me is a factor that's really hurting our chances for reconciliation. If I ever have the chance - for example, if he every says something directly about my family holding an eternal grudge - I plan to totally let him know that I choose him over them. Ex: "If my parents won't treat you with the love and respect you deserve as their son-in-law, then they're going to lose their relationship with me." Oh how I wish I had acted that way *before* we separated!!!
So back to you - maybe if your H brings up your family again, you could say something to assure him that you would side with him instead of them. That might seem like a total 180 to your H, but it also might open up some possibilities...