I'm with Piglet on this one, but if you think you can handle it, I think it would almost be better for you to drive past him every morning and just smile and wave like you haven't a care in the world.
If you CAN'T, and you think that he's going to suck you in, then you would be better off asking him if he can park elsewhere.