I once read a poem written by a Chemistry professor that said simply: "People copulate, and the molecule remembers ...".
Perhaps H's bad reaction in the car the other day is a conditioned defensive response, ... he somehow has to trust you and unlearn. The other side of the coin is the 'old you' may still be lurking below the surface.