You handled that well. It was painful, but it needed to happen. I still think you should follow up with a formal "no-contact" letter, approved and mailed by your husband, so OM understands in no uncertain terms that you are never, ever to have any contact with each other again.
I know you "feel bad" for him -- that's pretty much script in most affairs. But you need to get to a point where you realize that it was morally weak (and in fact, "mean") of this other man to be involved with another man's wife. He will have to face those own consequences himself, but he is far from a saint in all of this.
Truth dart: good people don't sleep with other men's wives, and try to destroy their families.
