I've been thinking about this and trying to get up the courage to give the ultimatum of giving up the OW and having no contact or moving out.
It's not a ultimatum, it's a boundary - his behavior which is unacceptable to you. When he joins a practice will he be OK with one of the partners spending time, money, energy and emotion with a competing group?
M22,H45,W45 S21/18D12 Retain faith that you will prevail in the end, regardless of the difficulties and at the same time confront the most brutal facts of your current reality, whatever they might be.