My wife tried to give me the whole "we're just friends" thing too, and even lied to our adult daughters and her own parents about it (which I later had to re-confront her on, until she admitted the truth to them). But before that, I told her "OK, let's suppose for a moment that's true. You're basically telling me that your 'friendship' with this man is more important to you than the wishes of your own husband. Is that about right? I'm not okay with that."
If I was doing something "X" that was perfectly harmless, but my wife told me she had a real problem with it (let's say, casual porn use) . . . I would stop doing it, out of respect for her wishes. She's my wife.