I will admit that I used to take off my rings when H traveled. For me it was a symbol to myself that I have a choice in all of this. He has made a choice to go against our marriage vow...I can choose to acknowledge that choice by taking off my rings.
It felt right to me at the time.
I had not taken off my wedding rings for 18 years, with the exception of when I was pregnant and too bloated to wear them!
Your choice. But I agree--don't do it for a reaction. Only do it if it feels right for you.