No. That is an insult. You've already admitted that you did the calls. Nothing was said, so what's there to talk about? If he asks, say "yes, I dialed her number...so?" There is no crime in dialing a number that I have heard of. Remember, he is the one having the affair. He should be apologizing to you for making your life miserable.
