"I'm sorry you feel that way. Everything I'm doing, I'm doing to fight for my marriage and my family."
That one's really hard to argue with (altho they'll often tell you "Well, I WAS thinking of getting back TOGETHER with you, but now you've BLOWN any chance . . .") b.s.
