Was your H at all upset that you listened in when his phone accidently re-dialed you? If he was, then that would be more of an indicator that some of what he was saying with the other guy had some truth. Otherwise, if he understood your feelings about what you heard, then you might just want to chalk this up as guy talk.
You have a set back in your trust now. Is your H willing to continue to work so as to regain it?