Brunch or lunch still negates the main point of a coffee date: its short. If you know after five minutes that the person is definitely not for you, or worse yet creepy and weird, you don't want to be stuck for a long meal. Coffee date implies it will be brief and both parties have a plausible out to leave relatively soon. It's just a MEETING, not a real date yet.