If it's his weekend to have the kids, I wouldn't want to go as a "family". If it's your weekend to have the kids, then you have to decide what you want to do the "family" thing or not. Me, personally, if he's not living under the same roof...separate cars and not play the picture perfect family when it's not at the moment...but that's my opinion. You have to decide what you are comfortable with and whether or not you want to put up w/his behavior.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.