Pressure makes him come back... and the stress of an exciting affair that turned into an embarassing scandal

Right now its secret, its exciting, its fun...

Once you make it into a painful headache for him to keep up with everyone talking about him at work and having to walk the gauntlet each day the affair loses its luster and working with his wife and reconciling is the most ATTRACTIVE WAY for HIM to SAVE FACE

The dirty looks stop once he reconciles... and e KNOWS it...