I have decided that, the next time I leave town, I will say to my wife, "Although I don't want you to see him, there is nothing I can do to stop you from doing so. However, I don't want the kids seeing him, and I don't want him seeing the kids. Fair enough?"
Of course, she will deny that the relationship is still alive, etc... blah, blah, blah, blah....