Yeah, but not wanting to be in an open marriage is not being controlling.
It is to a wayward. It's probably #1 on the Wayward Hit Parade -- "You're too controlling!"
Usually, it just means "It's so controlling of you to not allow me to continue to conduct my affair, unencumbered," or "It's so controlling of you to demand that I end all contact with my OM in order to remain married to you."
Sho, I reaaaalllly wish you would stop focusing on this one phrase, and CERTAINLY would encourage you to not make your DECISIONS based on it. It means literally nothing, in my opinion. It's background noise at best, and it's button-pushing at worst and I suspect it's the latter and I've pointed it out to you before. Your wife KNOWS that this phrase gets to you, and that it gets you to BACK OFF if she plays it.
You have a difficult enough decision to make without THIS white noise entering into it.