First off, be accurate with what you are asking yourself. Your mind is listening.
“Am I wrong to not want her talking to men…”. Your wants are not wrong. You are free to want whatever you like. Action and words are what’s truly accountable.
By the way, it’s clearer - Am I wrong to not want her not talking to men…”. That is what you “not” want. I’m not being the grammar police here, it’s just muddying up the waters keeps your mind tangled for longer is all.
Now the real crux of this, remove your wants.
Is it wrong for her to talk to men I don’t know.
No.
She is free to talk whomever she wishes to. You do not get veto power. Nor control over that.