Coly.......trust me when I tell you that I totally understand what you mean when you say that you don't like all the contact between you and H. It definitely can undue or set you back in all the hard work you are doing.
I remember when H came around me....it was too much. I had to ask him to please give me some space. I have found that when H sends me a text I don't responsd unless it is of very high importance. When I would respond with a "thank you" I would expect a "you are welcome" in return, and when that didn't happen it made things worse.
It is hard, but you have to let him go. I am still learning that with my H.