Is there anything you now wish you had done different?
I think if you have answers to those questions that you are ok with, you don't need others to vote on how you did. You have earned the right to say what you want, when you want, and then walk away take a break from it. Do it for you, based on what you think you need to do. That includes answering the phone or not afterwards. You gave him a message, and some time to digest it without jumping right into a discussion.
You already know that if something isn't working, try something else. Time will tell how this works for you, so relax and give time room to grow.
