"Later my D asked him to hold me down so she can tickle me..."
That's one may to turn him into a "Superior Man".

"I stayed in bed because my back is hurting a lot today. "
This adds to the labor cost for those paintings.

"Now H is gone with the kids for a walk but I couldnt go."
Looks like he likes to take walks? Perhaps with you and not the kids?

"All and all a good weekend. Even the interaction with H wasnt bad. He still avoided having the convo but it's OK."
As long as you can live with it. He may need some positive affirmation from you instead of the dreaded "talk".

"The only time he tries to get close to you is when you are actively pushing him away. Keep pushing."
Once he's close enough he would not need to "try" would he? It's like the N and S pole of two magnates. I wonder how he feels about this on a scale of 1 to 10?