Don't forget guilt as being a factor in not being able to come back. Some feel they have done too much damage to come back.
I had an affair and was almost a WAH but I broke it off completely and came back. I couldn't break up my family, couldn't do that to the kids and I knew it was wrong.
After the withdrawal period, I found myself so in love with my wife. It seemed like the blinders just came off. I could see her now, her qualities and value.
Committing adultery destroys one's soul. Afterward I was hit with depression, remorse, regret, hopelessness, guilt, fear and anxiety. I lost weight, couldn't sleep.
These are the consequences of adultery. God help your husbands when they realize this.