Some do die their own natural death, but even then, there is a LOT of healing that needs to take place, on both the WAS and the BS. Also, the longer the affair goes on, the stronger the emotional attachment, financial drain, emotional drain on the BS, and even medical issues if the affair is a PA.
