What Sandi says is probably true. But, I note, you and your husband talked about it. There was discussion. He was not so frightened of you that he didn't bring it up. So, I say, "Good for him!" And whether you like it or not, you thought about it.
The problem here is no discussion. Avoidance of the issues. Problems do not solve themselves, and they don't just go away. This will fester under the rug until it destroys the marriage. Surely, OIN is not about to trust his wife anymore.