I think by making the counter-offer, "If you want a 5-day trip with the kids, I get one first" you drop the unreasonable position without looking like a flip-flopper. You also get a chance to go on the vacation you planned and dreamed about with the kids. He has to plan his own 5-day trip.
