Did you sign a release for your therapist to talk with him? Even if you did, I don't think she could tell him "you have trouble with responsibility."
Sounds like he is just spewing....