I think one should never say never because then you have a ton of back peddling to do or you lock yourself into a position that you feel you can't move from.
I know how you feel. I stayed after my ex had the first affair and we went on to have 4 beautiful kids. I am done now, detached quite well and never wish to see any part of him but his backside as he walks out the door. Really not even that, but better going than the awkward look he has walking into my house.
This is your choice and only you will know when there is nothing there.
kat
Me-53(and learning!) S24, S21, D18, D17 Just keep swimming, Just keep swimming. Dory