MB....my H too had an affair...but with my best friend of 10 years. It's painful, it's hard. I commend you for being able to hold it together and not lash out immediately.
I think asking him what he did last night...gives him an opportunity to come clean, if not then you can tell him what you saw. I agree 200% with the 48 hours or you'll be telling the OW husband.
Have you checked out your cell phone records at all?