I'm more concerned about your children and your wife's emotional instability. I know living with someone as "roommates" doesn't sound so great. But to keep my kids safe I would consider it. Just my two cents....
If she's living with the type of guys you've described the statistical chances of child molestation do increase.
There is no arriving, ever. It is all a continual becoming.