I think you might be right. I think it is time that he is going to have to prove something to you. Look, he hurt you, physically. In my mind, that's a really slippery slope, I have no doubt that he would do it again, maybe worse. None of this means you failed, not even a little bit.
If you don't want to give up on him, that's fine. But make him do the work, now. If he won't really take care of his issues (no more drugs, no more violence, etc.), I think it is done. You'll be ok Lisa, better than ever!
