Like everyone is telling you, don't beat yourself up over it. I think you did a good job explaining your feelings to him. Unfortunately, since it was over the phone, you didn't get to SEE his reaction. Maybe it would have made his "it's ok" truly ok.
Erin
"A life spent making mistakes is not only more honorable, but more useful than a life spent doing nothing."
-George Bernard Shaw