Honestly I think you will say the most by saying nothing. I would not reply or acknowledge that at all.
My interpretation is that he is conflicted and is baiting you to push him farther away and/or make everything okay for him. Don't take the bait, remain silent and stick to facts and logistics.
Accuray
Married 18, Together 20, Now Divorced M: 48, W: 50, D: 18, S: 16, D: 12 Bomb Dropped (EA, D): 7/13/11 Start Reconcile: 8/15/11 Bomb Dropped (EA, D): 5/1/2014 (Divorced) In a New Relationship: 3/2015