What a horrible thing to say to you! I can't believe he'd say something so ugly when you were just telling him about D's crisis. Which I'm thrilled to know ended well. I can understand why those words would make you feel like sh%t, but wow - those words say everything about him, and nothing about you.
It sounds like he's getting angry at your detachment - which means it's impacting him. Which is a good thing, even if the outcome is ugly.
But at the risk of being negative, it sounds like this man is verbally abusive to you. Is that something you want your D to grow up seeing in her home? I'm sorry to sound judgemental, but I've read the background of your sitch and feel like someone with your heart deserves so much better.