No, it's not your imagination. That little ring makes a HUGE difference - I've noticed it myself.
WH hasn't worn his ring since March and I haven't worn my diamond since he moved downstairs. I also sometimes leave off my wedding band if he's being particularly annoying, and the difference is mind-boggling - I ALWAYS get hit on without my ring (LOTS of middle-age guys on the prowl around here!). Sometimes it's more trouble than its worth.
You're still legally married, so do whatever makes you feel the most comfortable.