Seeing Red, I've been reading along about your sitch.
I'll tell you how to deal with it. Don't worry what anyone else has to say or think about your sitch. They aren't living your life.
You'll find that what people don't know about your sitch, they'll make up. Confide in one or two close supportive friends that know how to keep their mouths shut and forget about everyone else.