I figured some of this had come out with the therapist. But that's not a bad thing and working through the steps of grief is really important.
Remember that worry can't rule your life. It sounds like you have "enough" and sometimes that's more than you will need. And you are right - you have many more of the riches that life holds.
I gave up a dream house after we divorced. A house that was built for my disabled son. That was hard. But truth is - I'm leading a simpler life. In the day to day stuff. Back to nature. Yes - I can still travel etc but don't go out much. And truth is - I worry about my financial future too. But I think that everyone does.
Don't let it eat you up. Make good choices. And remember that you are now and always were ultimately responsible for yourself. And stop blaming him. Be glad to be rid of him.