ladybug is right, it seems to be the norm for them to pull away after letting their gaurd down for a little bit. Just be prepared for that and don't let it disappoint you if he gets a little distant. Just keep doing what you are doing and let him take it all in.
