Wendy, OMG! I'm so sorry that you were put in a position of having to tell him no. It's flattering that he would ask you, but I'm like you...I wouldn't date your friends x's either.
Please travel safely and I hope you enjoy your Thanksgiving.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.