GOOD FOR YOU in standing up for yourself. Make sure you let him know, when he says "we're THRU!!!", that you didn't want him back the way he was anyway.
He's no longer calling the shots. I got lunch next time you're in Florida that he begs you back inside of three months if you do this right. Seriously.