I agree with NC. Until he is free of OW, he is going to continue this backwards and forwards dance. Give him his space, and let him see that if he comes back, he's going to have to be trustworthy and to gain your trust, he is going to have to be transparent.
I know how you feel when it seems like a constant merry-go-round.
Me:57 H:52 M:28 Got another lawyer last year and filed. D35,S/D twins28,D22 EA4/04 End? Who knows? "Life is like a mirror. Smile at it and it smiles back at you." — Peace Pilgrim