Cat, I heard the exact same thing--that the only outcome he could see to coming back was to continue to live "in misery." I realize now that he felt that way because it would mean living without the OW he had been sleeping with in secret for a year.
I don't think my x will ever admit to himself what he really did, or what he really lost.