I haven't read your other posts, but I wonder if he is just now realizing the magnitude of the affair and it's consequences. Perhaps he is ashamed and doesn't feel he has the right to touch you and doing so reminds him of the mistakes made.
In the relationship area he may feel as if all is well. He is back and things should fall into place.