I definitely think that you should give it a second chance. Remember, you just met a stranger.
When I first started this OLD BS, if I didn't feel this automatic connection, then I didn't give it a second chance. Now, if the first date was good, but no fireworks, I give it a second chance. You feel a little more comfortable and you can be more yourself and something else might come out with that.
You do seem to have a physical "type". You like them tiny and toned. Which of course is fine. That's your thing. But, I would look to see if it's because your exW was tiny and toned, or that is really all you are attracted to? I get that for a very long time, that's what you have known, so it might be hard to look outside the box.
hey, we all know I just jumped outside of my "box" or possible imagination of what I am attracted to. And woah, crazy amounts of attraction.
Stay open-minded, and don't be afraid to give a second chance. If it's not growing your interest after the second date, move on.