You gave him 10 minutes. Wait 10 minutes then knock on the door again and tell him that he and his GF must vacate at once. I would also have a digital camera ready that timestamps the photos and snap one so you have "evidence". Not that you will use it but it will shake your H up and perhaps make him think twice about bringing his affair home.
This is the ultimate act of disrespect and while it might be difficult you must set a firm boundary and if H does not adhere then you must enforce the boundary. Don't act crazy, be firm, polite, civil and don't show any emotion. I would also tell him that he has 24 hours to move out until you decide how to handle things from here on out. Yes, it may be his house but with the hardcore evidence you now have you hold a tremendous amount of power. Use it wisely and avoid any emotional outbursts.
^This. Yes. Do this.
Let me punch him!!!!! Greek
Me45 H46 T25 M22 S21 & 19 D13 Separated and filed 8/08 Moved home 11/08