At the risk of sounding like Larry Tate, you are both being reasonable.
I think he is being reasonable for you to pick him up at his place IN GENERAL. The hang-up about not wanting to see his apartment is yours, not his, and that's something you're simply going to have to get over.
HOWEVER, the DISTANCE of his apartment is, I believe, due to the fact that he wanted to live closer to OW? That makes your stance more reasonable.
On the THIRD hand (do people have three hands?), I believe you also said that his JOB is closer to his new place than it is to your house, so you probably won't have a leg to stand on there.
I think you need to compromise on this one Karen, I really do.