I think you are not doing anything wrong, but I would not really make what happened an issue. Don't write any letters, don't talk much about it. H knows how you feel, right? You don't need to pound it into him. I think this recent encounter may be him testing the waters and maybe it's best if he doesn't feel you testing back. I guess I think you should just hold off and see what happens next.