I gotta tell you I have NO patience with any behavior that will hurt the kids. Inexcusable and I would not tolerate it.
If your H has a problem with you (which we all know is HIS problem), he needs to take it up with you, outside of sight and sound of your S. He does not, and should not, take it out on your S.
Period. For me, this would be a boundary my spouse simply cannot cross.