I think if he wants to bring up the phone call I made to her last Monday and wants to start accusing me of looking at the phone records again. I'm going to say look - whether you believe me or not is a mute point. I see this as a defensive strategy because you tried to tell me you accidentally called her and then she gave you up. My intentions were good when I called whether you want to believe it or not.
Too wordy. Better:
"I'm sorry you feel that way. I just don't feel like I can trust you right now, and I find the need to protect myself."