I figured you were smart enough to think about that, but sometimes we can be so close to the situation that we don't see it! I think, in his head, he is sure that you could never attract someone, and he's trying to feed his ego by proving that to himself. Of course, yet again, he is wrong!
