After Xh's verbal abuse and me crying in disbelief, he tells me that my reaction is affecting the kid's behavior towards him.

Maybe his way of treating us had something to do with it? Don't you think?