You have come so very far and done so very well. You have a solid R now with your H.
This is JMHO when I read your post, and I am by no means and expert as my H isn't here with me.. <sigh>
anyway a couple things stuck with me. You were over come by that same dreaded feeling of insecurity that all too often comes over us all. your human!!
You know what and why you did that and your H probably knows why you feel that way too.
Ask for forgivness in a short, plain, matter of fact way. Explain your feelings and that you understand how that effected him.
Then leave him be. Feels almost like pursuing to me. You can't control how quickly he moves back to his previous place. You can only control you. Explain then move on.
Again, that was the feeling I came away with after reading your post.
Also, remember how far you've come and you'll come through this with flying colors too!
