I know what you mean about family. We told both families IMMEDIATELY (I mean the bomb dropped and I drove to my parents', came back and he took the car to his parents'). They have been extraordinary, and I never could have made it through without them.
BUT........
H's shame is part of what's preventing him from coming back (the clean slate) and he can't imagine ever facing my family again. This is a huge hurdle for us. He trusts my forgiveness, but not theirs. And we're both huge family people. He is a weak man and may be too weak to attempt to repair this damage.
So then I have to ask the tough question - "Do I want a man too weak to face the consequences of his actions?"