Yes, my H was just like yours! He was so unsure that it would ever work out because of the damage he caused. My H said that things would never be the same with us ever again. I said no they wouldn't because that M was dead. If he wanted to pursue a new and improved M that he would have to give 100 percent. It took a long time for him to take me up on it!
Don't tell him to go ahead and have an A. They seem to have those feeling for a long time afterwards so just let him get through them. Be there for him.