I think when your husband comes home from his "date," you and the kids should be gone. Seriously. He's "cake-eating." He gets to have his girlfriend, and he also gets you to cook and clean for him, and care for his kids while he goes out, and show kindness towards him.
He'll stop doing that when you stop allowing him to.
