Don't rush the process. I think you moved back in w/him too soon. He's still baking and he's still got some issues to resolve. You are going to find that you will become frustrated, disappointed and possible angry w/him because he's not grown up yet. You have expectations of how things should be and yes, of how he should be behaving...drop those expectations...treat him like a roommate and go on about your business. Again, I think he's still in the oven baking.
As for his decision to withhold affection because of the way he felt...sounds like passive aggressive behavior. If he does this, do not let him see that it bothers you. When he realizes that you aren't buying into that PA behavior, he may stop it. It's his way of controlling you, your thoughts and behavior. Don't give this man control over you.
My advice...if you find that things aren't progressing well and you are having more doubts, you may want to consider getting a place of your own for a while. Living w/someone in crisis who hasn't resolved his/her issues is difficult. You find yourself walking on eggshells and questioning your every move. If you haven't done so, read up on PA behavior.
I wouldn't reply to his texts unless they are urgent or a need to know. Give him something to think about. Allow him to wonder what you are doing and where you are.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.
