I remember back to something said to me... A couple of good months does not erase a decade of bad. You need to stop focusing on what other people are thinking about your changes. You are making these changes to be the best that you can for you... not them.
Memories are going to pop into you mind from time to time. Just a natural thing. How you deal with them is the difference. Let them pass and move along...
“Things turn out best for the people who make the best out of the way things turn out” ― Art Linkletter