CAC, Hang around the local airport. I know there are pilots like me out there that are not in the business of instructing that would be glad to take you up and act as PIC if you'd be willing to split expenses. That can't be just a local thing here. Also, how limiting is your condition? Are you on record for having been disqualified for a 3rd class medical? If not, then a sport pilot license may be an option. I know of older pilots who felt they wouldn't pass the 3rd class and rather than hitting that wall have gone to sport pilot. Even if that is closed to you because of your condition, you can still fly ultralights legally.
Just saying that you have options, and while it isn't the whole enchilada, it does get you a work-around. Yeah, all your eggs were in one basket. The basket got toppled, and eggs broke. While you can't make boiled eggs with what is left, you can still have scrambled eggs if you don't mind picking a few shells out.
Cac, with your statement about winning the lottery, it sounds a lot to me like you are making excuses why you can't. If it is something you really want, you'll find a way. Flying is expensive, as are many other avocations (boating and skiing come to mind). I probably can't really afford it with 6 kids, but I scrimp wherever I can to make so that it can happen. Yeah, I can't fly nearly as much as I'd like, but I do what I can so that I can at least have a piece of it. So, is it really something you want, or is it just a central fixture for your pity party?