Please do not say or do anything until you are in a calmer place. The calmer you are when you speak to him, the better. When we are emotionally charged, we tend to say or do things that we can't take back.
Also, have you checked out either online or w/a lawyer as to how all of this will play out if you ask him to leave? What would you be entitled to, how much support he would pay, etc. I would check all of this out before I opened the door and asked him to leave.
Step back for a few days and breathe. You will know when the time is right to broach the subject of him leaving.
BTW, one last question...what will you do if he says no? You might want to think about that response too.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.
