I don't know where you live, but in my state, agreements made with a mediator are considered legally binding. You can't just arbitrarily decide you don't like it. He's blowing smoke up your ass.
IMO, this is a fight worth fighting for. I don't know if you get what you ask. But since a mediator is probably in the know of what the courts will allow, I'd say you probably would come out a winner. I wouldn't be afraid to ask for what I want all across the board... but that's just me.
"There are only 2 ways to live your life. One is as though nothing is a miracle. The other is as though everything is a miracle."
