Don - I think you're actually realizing that you may be lonely for companionship. And maybe that doesn't have to look like marriage and commitment but that one regular woman in your life would be nice. Seems to me it shouldn't actually be that hard to find someone like-minded, but it definitely does take a lot of energy to date and sift through bunches of people to find compatible ones. Regular sex is definitely a great benefit of being in a relationship of some sort.
And you're right - it's easy to let a lot of time slip by post-divorce and then realize that time would have been better spent with a companion. It's just sometimes hard to gear up for the difficult work of dating.