Again, obviously your choice, but why the line on the sand for him leaving and coming back? What if you ask him to leave to go and figure out on his own what he wants. That is not the same thing as him packing up and moving out.
It is impossible to predict how anyone will react under a different set of circumstances in a different point in time. What if the H who wanted to come back worked through his issues, realized what an a$$ he has been and wants to come back and do right by his family.
How does all of you staying together to the bitter end with him not working on the marriage and you being unwilling to do so until he does any better?
I told my H he couldn't come back again. The guy who left cannot. But if he showed up with remorse, understanding and a conscientious desire to be a better husband and father, and I had not moved on otherwise in my life, I like to think I would give him another chance.
What are you accomplishing by keeping him there under the present conditions?