"Ohh well, anger never did me any good. Back to detachement mode. I'll have a nice evening with my little ones..."
K,

Neither anger nor detachment would do any good! Healthy communication will do you BOTH a lot of good. Instead tell him specifically what YOU want (very positive tone): to plan and spend time together happily as a family *every weekend* for the *entire weekend* for the next 6 months. Discuss how you both can work together as a team to make this happen. Lead!

(Avoid assumptions(guesses) of his motives, blame, anger, criticism, contempt, defensiveness, finger pointing, withdrawing, ... all negatives. When you feel hurt tell him how YOU feel specifically about such and such without getting angry at him - takes a lot practice, duct tape and biting your tongue - and yes, it is indeed your problem, but after you have communicated in the proper way then he may make it his problem)

BTW keep your business end up ;-)