Rys, I agree with you that we are to turn from those things which are not good. We are to think on those things which are true, honest, just, pure, lovely, of good report, and if there is any virtue and praise think of these things. That's from the Bible. Most people are very worldly, and don't really care how God told us to conduct our lives. Or they think God should change with the times. Jesus did not say never to judge whether or not a behavior is sin or not, He was saying to be prepared to be judged by the same standard of judgment. It is a warning against self deception and hypocrisy.
That being said, we are also are to live in peace with our spouses, even if they do not believe as we do. My S and I are Christians and my H is not. The Bible says the unbelieving H has been sanctified through his believing W. Many a H or W has been led to Christ through his or her spouse. My H is happy to go to church with us, and I hope one day he will become a Christian. It will be a happy day for me to see him walk down the aisle to confess belief in Christ and be baptized. But until then, I accept him for who he is. He would never corrupt my S, and I don't believe your H would corrupt your S, either. I think Howard Stern is despicable, too, and if my H listened to him, I would leave the room until it was over. Even if I don't agree with him, I have to respect him. You can't beat a man over the head with what's right and wrong and expect him to stick around. That doesn't win souls to Christ, either.
Have you pretty much decided you don't want your H back? If so, then you do have the right to D him, since he is committing adultery.
