So, he just tells the OW that they have to be wayy more careful. And so the affair continues. With no consequenses of their action it will continue. I can see them getting together and laughing at you that you cannot do anything about it.
Without exposure, this thing will kill your marriage. With it, the possibility of killing the affair is real and only then do you have a fighting chance.
When talking with friends, remember do not confuse advice with support. I'm sure that he was just trying to support your decision of not exposing. We are not friens with you, just people that were in the exact same situation that you find youself in. WE WILL TELL YOU THE TRUTH of what we would do or what we have done when we were you.