This is a good DB excercise for you. I'm assuming communication is one of the core reasons you are here so try this...
Simply tell those nay sayers what your intentions are and why, ASK them to support you if they can and if they can't to please keep the negative comments to themselves.
I heard the same things, but when all was said and done, some of these same people told me how my resolve really stood out.
you are in a defining moment in your life. There is no downside for taking the high road.
