All of your emotions make perfect sense.... but he doesn't need to see them! You can do it! I expect that you have cooked up a pretty awful story in your head.... why not cook up one where you'd be glad just to hear from him when you do? So that you can sound happy to hear from him rather than upset at what he's been doing?
