Thanks Steve and Nicole. I see merits and demerits to both. For now I will try the mediation route, with both of us wanting opposite things it might not work but he at least cannot blame me for not wanting to mediate and listen to his side. Well, if it fails he will get angrier about not agreeing to his terms so it seems like a lose-lose with either option at this point.
