Oh I am so sorry. Your so close but yet in your mind so far away. If you hate him leaving, then put in a little hint. Say it. Say it makes you sad when you have to see him leave. That you miss him. Tell him how you feel. Then it will not grow and fester inside of you. make him feel too, at the same time, loved and wanted and that your sad that he is leaving you. It will put that bug in his ear to sh*t or get off the pot so to speak.
Anyway I understand your frustration. Just don't let it all build. Part of a marraige or a relationship is communication. That is true of your feelings just as well as his. He can't read your mind to know how your feeling. Just your gestures you send off to him.
Hope you have a better day. Wave at me while you go by Georgia. It is so nice here lately.