Hey, any guy who doesn't respect your need, which you politely outlined, isn't worth wasting coffee money on in the first place! I'm no expert but I think you were in line. I think giving out your phone number too early is an invitation to harassment, who needs that!
