It's not a consequence for him...how will it affect him? I mean personally, I think for you....walking away and refusing to participate is great...and I think you should do that, don't get me wrong, I think that's a great approach. Let me see...if I can rephrase this...what does he have to lose? A firm consequence is...."If you continue to treat me this way...you will lose me, I will leave....or you will." In saying that I don't mean...just walking to the other room either.
Now, that may not be something you are prepared to do, but try to think of something that's going to rattle his cage a bit. My 1st impression when I read your boundary, was "that's a great starting place" but it's not likely to wake him up.