I am super impressed with you owning your stuff and apologizing despite all the stuff he has put you through and things he has said. Other people's actions and behaviors shouldn't prevent us from being the people we are deep inside. Way to go! That's HUGE!
Also, I tend to think that a hug is a hug is a hug. Take it at face value. You two just worked hard in the yard and did it as a team. A hug is a nice thing and he's trying to show you that he has compassion. I guess. It's a nice gesture. Take it for what it is.
Breathe. Let your emotions come but not control you. You have faced A LOT lately. Take care of your heart.