It depends on your position. Since you are not interested in reconciling, then if you want to help the father of your child and offer him a place to live, leave it at that.
However if there were hopes of reconciliation and he moved back, and then you knew he was still hanging with the broom, I would not want him living there anymore. All depends on the boundaries/terms you have set for him and for you...
