It may be a wierd weekend, but you have the chance to make some more nice memories. Don't worry about his leaving, enjoy as much as you can.
It will make whatever sense it makes to them (or not). You'll have to deal with their feelings when they come up. IMO it's best not to vilify your H, but I know there are differing opinions with regards to this. I also know how hard it is not to do this. I have nuts and bolts holding my lips shut with regards to this. Even so, I have two D's one 15 and one 13. They are by no means dumb and my oldere one has always had a sharp mine with regards to very complex situations (darn books ). You do the best you can and when you know better you do better.