RJ2, all I can say is that HE was calling you his W, HE was saying "we" and then YOU said "we" and he got weirded out.
Frustrating, I know, but if I'm right, you can't mention "we" anymore.
Ex. When my H wants a hug, which is often, he comes and hugs me. One time, I needed a hug, and I went to hug him and his hands hung at his sides. I was so upset, but I let it go and have not since tried to hug him. He comes to me.
Try it and see. Let him make the "we" comments. He will feel more in control. Seems like right now he feels as if you have all the control, and he doesn't like it.