**** Is he just not attracted to me or is it residual feelings for OW or guilt or a combination of all three?

I would guess the last two.

Even now my wife and I have problems with intamacy. I'm not just talking about sex. Just holding hands, good night kisses etc.

It's a bit myopic to say it happens with every returning cheater, but it has in my scenario.