Regardless of the issues in your marriage, he is still your children's father and you are still married. He needs to step up and take care of his kids.
My mom went through breast cancer. Watching my Dad's devotion to my mom during this difficult time was one of the reasons I refuse to give up on my marriage.
Don't be afraid to ask your husband to live up to his responsibilities. What's the worst he can say - No?