I think the best demeanour to aim for is pleasant, breezy, busy, distant...
So, your W shouldn't think that you are being narky - just that you have lots going on in your life and limited time to interact.
From what you're saying, you may want to 'up' the pleasantness - ie: not refusing to speak, but being the one to break off the convo first as you have something else on etc.
T 13 M 7 Me 48 H 46 SS 15 BD 7.14 PA D final 5.16 (H filed)
We receive & we lose, and must try to achieve gratitude & embrace with whole hearts whatever of life that remains after the losses - Dubus