all I have to say is... you said "I'm not even sure if I want him here" If you are not sure you want him there then don't have him there. Would you have married him in the first place if you were unsure about it? Don't have him come "home" until you are at least 95% certain you want him there with you.
