IMHO it is the old pursuit and distance sich. As you pull away and detach more from him he is trying to keep you "not too close and not too far away". Just like a little boy with their mother. Wants his freedom but does not want to lose the ties with his mother.
All you can do is to stay on your path, continue to detach and keep the ball in his court.
