Ginger, I think you did the right thing and it shows him that you are a classy lady because you stated exactly how you felt about the situation and you didn't "ghost" him like he would have possibly done to you.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.