Before you make him leave, make sure to get an accurate (as possible) list of assets and liabilities. Also find out if any of the recurring bills are in your name. You'll want to make sure that those are paid. A wayward spouse tends to leave his or her responsibilities behind and, in many cases, you'll have to pick up the slack.
