Nah! I think that the relevance of "size" is vastly overstated/represented in the folklore and the media. At least personally, I have been quite attracted to women of various sizes, and can't imagine that being a make or break type of issue. Or really, any issue at all.
A nice smile is a thousand time more important that the size of your chest. At least.
