I think it is excellent that your kids are wise enough to understand whose problem this really is. And that they can almost pity him, that is mature, too.
I love how you said it, that the three of you are a team and will love and support each other and stick together. You will grow happier with time and he will probably continue to grow more unhappy. That is what I expect on my end, too...
Still, it sucks. I am sorry and I am here for you. We all are.