I'm so sorry to hear this is happening. I have been following most of your story, but haven't posted much as I am kind of new to DB and didn't really know what to offer in way of advice--
I grew up with a social worker mother and taught elementary school-- a weird outfit, even a "shortish" one, is NOT going to cause you to lose custody-- I agree with others on here-- H is causing harm to D by taking your transportation, messing with her routine/arranged times, causing her to miss appts. this week etc. thats not even mentioning the money sitch he is putting you and her in-- He is NOT thinking of her and I think a judge will see that.