Let him twist in the wind for now. At some point, down the road, when he pulls the same "woe-is-me" crap, lay this truth dart on him:
"Unfortunately, (Husband), some toothpaste can't be put back in the tube. Our entire family is going to now have to live with the consequences of your affair, including (DD3), which is saddest of all."