In your situation wife is the LD and you are the HD?
I think anytime they go elsewhere when they are not being denied there is a problem. If they are being denied it should be discussed and you will know where you are at. I'm sure most people won't announce that they are going to cheat.
