I guess I meant to say that you have to *think* of this situation as being separated/divorced from your husband. Think of it as the only ties you have is kids/finances.
Yes, your husband likely won't return to the marriage with OW around. But, you cannot make that decision for him.