If he hasn't hit you yet, then he probably won't. But at a calm time you should discuss with him how frightening those words are to you and how destructive they are to trying to rebuild your marriage.
Have you and he seen the movie "Sex and the City"? It is a good movie about forgiveness. I'm not saying the movie will cure you. I think it is food for thought and could be the subject of a calm conversation by the two of you.
You and he need to have calm conversations. You need to stop the fighting. I think an individual counselor for you could be helpful, but you two need joint counseling and/or Retrouvaille.
You need to stop confronting. If you have a counselor, then save the bad stuff for when you are with that person. You need a referee. When it comes to reconciliation an eye for an eye will not get you anywhere. He did this, you said that, it all leads nowhere, at least nowhere you want to go. Reconciliation requires that you become better people than you have been being. It requires you to reach out to each other, to show compassion, to apologize and to forgive.
