My family says the same - my friends too. That he's being horrible, etc. While, a part of me (my "taker") agrees another part of me (my "giver") knows that he must be hurting to be in the place he's in. I imagine he's conflicted, confused...etc. He is human after all, despite being the shell of a man I once knew.
I love your 180s, they're inspiring me to write out mine in a little more detail. Self improvement for me is a big thing too. I swear, if there is ever a next man...even if it is the H, they're going to be like...damn.
The H's mom is also a support for me as well, and our relationship has really grown because of it all.