GGB thats why confidence has to be built on something other that success. I think the best thing to build it on is your own ability to deal with adversity. Not to build it on success but your ability to handle failure. This may sound negative at first glance but really its about freeing yourself from fear.

I saw an interview with the comedian Dave Chapelle where he described the liberation he felt from failing completely in front of an audience. He was giving an early performance and people booed him off stage, what he though would be the worst moment of his life, the thing he dreaded had happened and he discovered that it was ok. He took that experience as the fact that he can handle the worst and let that free him.

Much in the same way once you know are able to handle the inevitable rejection/conflict that will take place in any relationship you have a much more solid base of confidence in my opinion than one contingent solely upon success.