if you're able to break away, go. Hell, go to lunch anyhow -- tell him you're going at X time, he can meet you there if he can - otherwise enjoy time to yourself....
....Understand, that I can't, not be what I am I'm not the milk, and Cheerios in your spoon ~ Avril Lavigne ~ ..."Nobody's Fool"...