Patience!!!! It sounds like your husband may have lost his fantasy relationship with OW and that takes time to get over. Stop giving so much. Do for you, do for your daughter... let him come back to you in his own time.
It's good she lives elsewhere. It will be much easier for both of you.
There is no arriving, ever. It is all a continual becoming.