He is attracted to you and still has feelings for you and then realizes that he shouldn't be warming up to you, so he backs off. He needs to justify why he left or feels the way he does, so he can't have those warm and fuzzy feelings for you and that's why he distances himself once again. Also, it could be part of the distance/pursuer game too. They come close, we start to think that they are waking up and begin to have hope, etc. The best thing to do is stay the course and allow him to flit around and see if he continues to come close.
They remind me of a moth who is attracted to a candle. They come close and slit around the candle and when the flame is put out, they flit away once again.
Stay the course and continue as you have been.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.
