I just wouldn't answer it. Tell him you won't dignify it with a response. I wouldn't let him try and turn it around on you so he can justify his own bad behavior.

"You can't reason someone out of a position they didn't reason themselves into."