Everyone is right. Just listen, validate him. He is confused and only he can make the choice of staying or going. The fact that he can't says so much. It is hard for you to live with but you have been doing a good job so far.
If he is still here tomorrow, then keep DBing and giving him space. Focus on you and the kids right now. Take one day at a time.