I can't believe your H... what does he expect? If I recall correctly, you never did a full exposure to family and friends. Probably does not like the idea of the truth finally coming out.
The only people I have talked to about the A are: 2 of my friends, H, and our therapist. So I understand your feelings of carrying the burden alone. ((hugs))