Don't sit around waiting for him, or you'll just feel like a doormat. Besides, the OW may never let him come.

I'd let him know that you will be at home on the 23rd for these particular hours, and on the 24th for whatever hours ... and if he can't make it then, well, you've got other commitments. Don't change your plans if he wants to change his--you're the one that's giving stability to your kids and getting a life, after all.