Fixing the damage he has created over the whole time will take a huge amount of grit and strength. He sounds like he has continued to be very week. Too weak to cut it all off with OW. Too weak to be honest about that with you, or even himself.
I would say that kicking him out is a bandaid. The thing you both need is for him to learn that the pain of being honest is much less than the pain of being caught lying. He must learn this in order to have any kind of R with you, in or out of the house. Maybe your actions will help him understand this. But if that is what you want in the end, you will need to be willing to discuss it with him in a non-threatening way.
Repeating to him how much the lying has hurt, needs to be balanced. If he does open up to you with what would otherwise be a painful piece of news, can you see yourself telling him how much more it would have hurt to learn the hard way ... and thank him for his honetsy? I doubt that he would ever have seen that one coming. But it could encourage him to repeat the practice.
What I see on these threads is that reconcilliation is this hard, and does take a long time. If it took him months or years to screw it all up, he can't fix it in weeks.
My prayers are for your peace of mind and restoration of your calm and happiness. Hang in there. Give all this some time to settle and see how you feel then.