Some responses if he challenges you about calling OWH

Husband : So, you are cheating on me with him now?

You : No, that's you sharing your business with that family, you are ripping that home up, not me.

Husband : You shouldn't be calling him

You : As long as I am PROTECTING marriages rather than DESTROYING them I will talk to whomever I want to. Or don't you approve of me saving someone's marriage?

Husband : I dont' want you talking to him

You : I am going to my karate class. Dont' waste your time trying to get into my PC, I am not stupid enough to leave anything there for you. It's all safe and backed up elsewhere. Ta - Ta.

And you head out to wherever you want. Just exit the house and let him stew