I don't know what to tell you. Fear haunts us all. And asking for reassurance doesn't help. It takes time to rebuild trust. You need to practice trusting him and he needs to practice being trustworthy and trusting you. It is not easy. It's not easy for anyone. That's why they recommend not having affairs in the first place.