Never settle if that is what you feel like you are doing. This must so tough for you to come to that decision because it is easy to be safe and to feel comfortable. But if you are frustrated with him and have tried to work on that than maybe it is best to cut him loose. Easier said than done, I am sure.
