"I don't ask often. Probably 3 times since D4 avoids me."
You shouldn't ask at all.
"I don't demand answers from D4 too. I just let it go if she doesn't want to answer."
Again, you shouldn't even ask her at all. Stop doing it.
"XW and I have come to an agreement if D4 doesn't want to follow, I'll just take D3 out instead."
Who came up with it? The two of you hadn't exactly been the best parents. Have you talked to a C about what to do in these situations? Get professional family C.
"It's best for the time being."
Doesn't sound like it. All you're doing is enabling the behavior.
"I don't have the answers."
You act as if you do. Read the posts and learn.
"D4 did say she was afraid of me once."
Of course she is. But you can't put her on the spot and ask her a question that she doesn't even understand.
"I am pretty much frustrated over her avoidance. I try to let things go."
Are you talking about your W or your D?
So have you figured out how they can stay overnight with you?
M-43 W-40 2D - 9 and 5
Emotion, yet peace. Ignorance, yet knowledge. Passion, yet serenity. Chaos, yet harmony. Death, yet a new life.