But I really don't want to be D, and if I never speak to him then that's exactly what I will be!!!
I do NOT agree. Stay dark. Believe none of what he says and 50% of what he does.
NC is a form of communication. He can hear what you are saying. He may not like it but he "hears it". If he really wants to send you a message you will know by his actions not his words!
You are fine on your present course. You are not rude, you are just protecting yourself.