Your H crumbling emotionally in front of D4, staying at your house, and playing with her is sending her the wrong message. It is incredibly confusing to a child.
He is going to keep finding evidence to blame you for things. He literally can't handle the transition, and then turns around and blames you for the difficulty.
I wonder if changing up your transitions might help D4. Could you drop her off at your H's residence instead?
