I think it is time for some direct communication. You don't KNOW what H meant by that comment. To me, it sounded as if he was resolute in not allowing it to happen again because he is afraid that if it does he will lose control and hit you. Of course, I didn't hear the conversation. Still, I think it is time you quit ASSuming you know what he meant.
"H, I was very scared by something you said. You said "______________." I took that as a threat. Is that how you intended it or are we miscommunicating somehow?"
If he meant it as a threat, then you already know what you should do.
