If I were in your shoes, I think I would take care of my kids and whatever our needs were (home, clothes, ete.) but I would not give H any money. That may sound cold, but that would be my starting point. Don't let him live off of you. Don't pay for any "toys" he might want or anything he asks for himself.
I think this ^^^ would be an awesome place to start, Tina.