If I had the affair and there was a chance of running into the OP then I dont care what gym, grocery store, bank, etc I met this person at. If I know that the OP works there or frequents it I would avoid it at all cost as respect to my partner. period.

I would first of all feel bad about my affair and would be willing to do anything to gain back the trust that was broken.