You are probably tempted to take him back. You must make sure he has really changed. That is, he must come up to your standards for you to take him back, not you simply accepting him the way he is or has been.
I recommend that he not be taken back until after he completes a Retrouvaille weekend with you. The weekend is a good time for him to come to understand all that he has done wrong and to ask your forgiveness in a meaningful way. (You will also ask for forgiveness for whatever you feel you have done wrong.) It goes on to investigate what kind of changes you both are willing to make to make the marriage work. It is a turning point. Without a turning point things don't really change. And if nothing changes, then you know, nothing changes.
At least he is feeling remorse. I hope you can take some comfort in that whether or not you choose to take him back.
