This is not a scary thought, actually. Leaving the old life behind is so welcome to me now. I'm looking forward to that immensely.
I told my H early on when he started acting strange and I knew potentially he had a new OW in his life that I was going to take care of myself, do things to make myself happy and go on adventures and if he wanted to, he was always welcome. I don't think it registered then, but maybe one day that will come back to him from out of the fog... my new life looks great, if I can just LET GO of the rope. I slackened it but then when I turn to go, it becomes taught again... so I have to release it entirely...
It sounds like you have done that OOH and that's wonderful.