It is also possible for the distancer-pursuer dynamic to totally flip in relationships - it is a position, not something intrinsic about who you are. And perhaps he knows that you're there, waiting, ready to work on things if and when he decides he feels like it or has the time or energy. Perhaps he would get around to tackling his abandoning issues and his inability to communicate and his prioritisation of work over family and children if he felt that he was about to lose you.