Go. Just Go!

It's your trip, if he has a problem he should change HIS schedule/itinerary.