Then why do the ladies that seem distant to you bother you?
I didn't get the impression that it bothers him at all. The fact is he has no idea why these ladies may not enjoy dancing with him. It could be that they like him so much they are nervous and embarrassed around him or maybe he reminds them of someone they don't like or maybe there is no connection there... Whatever the reason, Burg seems to be able to just be aware of this and not let it be any reflection negatively on himself.
For me I used to work with a couple of engineers that I didn't think "liked" me. Now most people I worked with liked me and I say this because there was a joke about how the guys would line up outside of my cubicle to talk. These two guys were NOT among them. Anyway, while I noticed I didn't really worry about it because not everyone has to like me:) So we could work together and I was not at all clingy or bothersome to them. Flash forward a few years and those two guys ended up being fairly good friends. Maybe initially there was something they assumed about me that wasn't true, maybe they just take time to warm up to people, who knows. All I know is that if it had bothered me, I would guess that my worried behavior would probably have prevented us from becoming the friends that we became.
But what is happiness except the simple harmony between a man and the life he leads? ~Albert Camus