not sure what your faith is, I'm Catholic. When the bomb was dropped on me, I thought about my vows. Good times and bad....and this is a bad time. Most people have a little asterisk on their vows, hidden from everyone. It is unseemly to state exclusions to vow of marriage. An affair is usually part of that asterisk.
I understand why you want to move forward with your life, and how a divorce could help you there.
Only you can decide what is right for you.
Only you can define what keeping your hands clean looks like.
Have you met with your priest or clergy? What did they have to say?
H 34 W 29 BD 3/12/18 Divorce Busted Spring 19
It is not things that bother us, but the stories we tell ourselves about things.