Hi IP, I honestly think that your H hasn't felt the loss of his family as he still comes as it pleases him and he has food on the table. I know it's very hard, on the other hand what have you got to lose to put in place boundaries that will protect you emotionally. He has sacked you as his wife!
I'm sorry if I sound so harsh, it's only because I care for you and I have been in your situation. The best thing that happened to me was to limit my contact with him ( not his kids as you don't want him to use it against you). Honestly it is doing a world of good to me, even though if it isn't helping my M.
I'm feeling stronger and better by the day. Like you I was scared of him filing for D, unfortunately if he wants to do it I can't stop him. YOU are your priority, YOU need to look after yourself, rebuil yourself emotionally so you become a stronger woman when and if your H comes round and you'll be a me to support him as you'd have dealt with your issues.
You'll become a woman only a fool would leave :-).
I'll all the way be there with you as I'm few steps ahead of you :-)