The anger is guilt processing... People on this forum mostly interpret infidelity as an ADDICTION.. And addicts can RAGE with the best of them.. I don't know if you have experience dealing with alcoholics or such, but this isn't much different...
Rage is pretty common... Spring in After the Affair makes an excellent comment :
Certainly while you are having the affair, and even after it's revealed, you may feel more anger toward your partner than guilt. That's because the two emotions are inversely related: The greater your anger, the less your guilt; the more venom you direct at your partner, the less you direct at yourself. The anger you experience may be a legitimate response to the way your partner has treated you, or a defense against the guilt you feel for what you've done("It is human nature to hate those whom you have injured," wrote Tacitus, almost 2,000 years ago). What makes it hard to know the difference is that anger always feels justified -- it's a basic characteristic of the emotion.