You may want to consider professional help for you and your H. Getting over an affair is not easy. I know if my W ever wanted to reconcile, I to would have issues with intimacy and may not even feel comfortable taking her back. I have not had to cross that bridge, but understand your feelings completely.
"It is curious that physical courage should be so common in the world and moral courage so rare." -Mark Twain
