I wrote before that I didn't know how I'd take a letter, but in retrospect I think it's the right thing to do. You might want to consider sending the letter and in the letter ask for the face-to-face. That way you have time to compose what you want to say in the way in which you want to say it. Sometimes things can take a wrong turn during the face-to-face. If he agrees to the face-to-face, he then has had some time to process and it might make the encounter more meaningful.