That's victim talk. Having an affair is a choice. You didn't do anything to deserve to be cheated on, just as your husband didn't do anything to deserve you cheating on him.
There is no tit-for-tat; he doesn't get a free pass on an A just because you had one.