As incredibly HARD as it is to do, the best thing to do in a situation like this is to -- as cheerfully as you can -- say something like "OK! Your loss, toots, cuz I'm gonna look HOT Saturday night, too! Well . . . I'm going. If you wanna come, great. If not, your loss!" -- and walk away.
And then, of course, GO.
I know that's easier said than done, but he's pulling your chain -- controlling you. The more you act like it doesn't bother you, the more you'll throw him off his axis.