Grr, why are you upset with yourself for confronting your H? I am not saying you were wrong or right. It isn't up to me to judge that (and I am not making a response to anyone else who may have either). My question is why? Why did you feel the need to confront him? And why are you upset with yourself for doing it?
From my own personal view, if my W did something similar and I had a similar reaction/action, my introspection is that I do care about my W and what she is doing/has done and we had made a committment to each other that was supposed to last a lifetime.
Were you wrong? I have no idea. Sometimes I think it isn't a bad thing to let our other half know what they are doing is wrong (it may not be good DBing though but...).
I do care about what you are going through. I am sorry.