Tell him that you specified to him that you didn't know when you would be back and that if he had a problem, he should have told you. And that if he had plans you would have had someone else watch the kids. Tell him in a "matter of fact" way.
Your H is very immature right now so forget about what he's telling you right now. Just keep concentrating on yourself and look killer every time you see him. Show him that he doesn't "own" you.
M-43 W-40 2D - 9 and 5
Emotion, yet peace. Ignorance, yet knowledge. Passion, yet serenity. Chaos, yet harmony. Death, yet a new life.