Sweetie, please try hard to let him go. It doesnt mean you stop caring. It just means that you are not going to let him, what he does or says or how he acts affect your life.
I know it is a difficult thing to do. And we all get there when we do. But it is freeing, this letting go.
It means you are moving forward. It means that he does not have any control over your life. It releases you.