I think you have WAH thinking. Take a moment and think what you were doing/saying to elicit the increased contact from him. Perhaps you are feeling more detached and he can sense it?
Keep doing what works and don't let your resentment creep up on you. I often hear that this is the case when the balance of power begins to shift from WAH to LBS. It'll be your job to reign in those feelings for the time being and not rip him a new one.
Also, remember even though you feel anger right now (rightfully so), your feelings tomorrow may be of longing for WAH again.
Take things slow and don't react at this stage in the game.
Also, regarding the hurtful things he said early on... Believe none of what the say and only half of what they do.
