In terms of the M, there's no difference. It's either he stays committed to it or not. Your H is saying the exact same things about you that he said about his W at the time.
There's a reason why they say marriages of people who have had A with each other don't last. They don't deal with their original issues. Sounds like his W was "clingy" because he made it up in his mind that he never loved her. Same thing he's doing with you.
Even if you had done the exposure to his friends, I don't think it would have made any difference because he had done it before. Having a child "by mistake" doesn't make the M a mistake. You know what you're doing and the you live with the consequences. He doesn't want to do that.
Rather than facing himself, he looks for some external source to blame. Running away is much easier than looking at your own faults.
Maybe you need to not be as clingy as his XW was and see what happens. Does he have any contact with his XW and his kids?
M-43 W-40 2D - 9 and 5
Emotion, yet peace. Ignorance, yet knowledge. Passion, yet serenity. Chaos, yet harmony. Death, yet a new life.