(((Jo))) I understand your feelings. It impossible to deal with someone as irrational as he is. It's disgusting that he has custody of himself even. I suggest that you start (if you haven't already) writing all of the incidents down that you can remember and keep a journal in the future of your interactions with him and the girls. Someday you may have to pursue legal custody of them and having all of his nonsense documented may be helpful.
I know that this has been suggested to you before, but is there a way you can get free legal help in this matter? Maybe not to regain custody at the moment but a way to see them more often and yet not have to see him (ie restraining order)?