No; it needs to be something that says: "I know where you are, and I know who you're with." Simply mentioning "the affair" just makes it seem like general accusatory rambling.

How would you saying you know where she is jeopardize the source of your intel?