You need to be loving, but also set some boundaries my dear friend. While you are new to this (and overall doing very well) you have to really accept the current situation as it is. Family nights are fun, but they do lead to confusion for you and way more important than that, they lead to confusion for the kids;
"What are we doing, just pretending everything is ok? Are we that family now?"....as a case in point.
One of the things I see a lot with the women on here is that they let the WAH swing by the house whenever he wants for these family nights. The husband gets his fill of family time, but it leaves the women and children confused. Is that fair for the kids?
Another thing I have noted....is that must of the men I know who returned to their marriage, did so because they missed seeing their kids. That missing of the kids was the motivation to help them see their marriage in a different light and start working on the marriage again. Right now your husband has chosen to leave the marriage....his choice....and a consequence of that choice is not seeing the kids daily or whenever he wants.
Remember...You cannot miss the good times if they are readily available to you....Think about that.