I understand completely. I think whether or not you have "evidence," it is inappropriate and it is making you uncomfortable and losing trust, and that is a breech of your comfort level in the marriage.
Is he home yet? I don't know where you live, but it's after 11 pm here EST. Wasn't he coming back tonight? Or is it tomorrow?
