When I would notice someone doing that to me... I'd think the... 'what gives?' thing, too. If you don't want to know... why ask?
Then I came up with a list of 10-15 smart-azz obscure answers to throw back at them when I noticed they really didn't want to know... and amused myself thusly...