You have a bonafide cake-eater on your hands. A wife and family when he wants them and all the women he can date when he wants them. The cure for a cake-eater is to take the cake away. You have the power to do that or you can put up with this abuse because that's what it is.