You'll get used to it eventually. It'll take a while because you'll be breaking the habits that you have built up over a number of years.
I would suggest to you that everything your h says to you has an ulterior motive. So....practice that No word. The next time he asks if you are going to town say No. End of conversation. He'll maybe try to carry that conversation on. Believe me you'll have to be strong.
My pattern now is:-
1. Answer to h's first question.....No.
2. Answer to h's second question (usually why?)....Because I don't want to!