Don't be sorry. I think what you told him was spot on and very well said. Our WAS's fail to own up to the fact that it is because their decision to violate the M and leave, that our children our forced into a time-rationed existence between their two parents. Whatever our shortcomings were, we stand ready to make corrections and strengthen the R and family. They are the ones who have decided to walk away and tear apart the family.
Stay strong for yourself and your children. Your H will see your strength and respect you more for it.