I got the controlling speech when I caught him red handed both times. After the first A when I couldn't trust him and started looking at phone bills, emails, etc and he would have to check in with me where he went he said that he is a "big boy" and shouldn't have to ask permission or tell me where he was going.
Nope. He shouldn't. He also "shouldn't" have had an affair, but he did, so now he gets to deal with the consequences of it, and one of those consequences is, YOU don't trust him, so in order to trust him, this is what he gets to do now.