Well, ok, now you know - I'd bet dollars to doughnuts that he was having an affair with this woman long before he moved out, and that THIS was the true impetus for him moving out, nothing to do with you.
A look back at old phone records might be enlightening.
Not that it changes things, except you might look at his criticisms of you through a different lens - yes, we all have things we need to change about ourselves, but I'm pretty sure he's blowing smoke up your hoo-haw when he tries to justify why he left - he left because he was having an affair.
