When my H first moved out, I thought it would be easier to accept if it was for someone else. It seemed a decent reason rather then the drival he told me and then also it wouldnt have been about me. Now that I have realised that this is probably the case after all, it is actually worse. Why did I think that if he was having an A it would be easier to accept. Because now it is about me - about me not being a good enough wife and him finding someone else better to replace me.
Hey! No self-pity parties. This is about him and his crazy brain operating differently. You aren't to blame for his actions. Allow him to have responsibility for his actions, he did this, it's his fault, not yours. You are a good enough wife and if he had problems, he could have been an adult about it and voiced his issues and told you what he wanted but he flaked out and used that as an excuse to find another woman to be with.
He didn't find someone else that was better to replace you, she is different, that's all, not better.
Don't belittle yourself or disrespect yourself by thinking these thoughts. You're a great person, you have a ton of value, if he can't see that, it's his loss, not yours.
As for his comment about what you might have said, you tell him that people that live in glass houses shouldn't throw stones. Plain & simple and leave it at that.
So Lea when do you start casually dating other men? It might be the boost you need to rebuild that confidence of yours and it might be the kick in the pants he needs to wake up his reality.