Don't worry about letting him go. If you're focused on that, it will be the last thing you can do. Just forget about it and go about your life as best you can.
You are already getting a life.....so it will eventually just come to you.
Your anxiety might (and might not) be best helped with meds. Or things like yoga. If you try to look at each moment as a gift....(as the moment is happening....i'm sure you do appreciate your moments)....it might help...you know the phrase...'be in the moment'.
peace and all good, sg
sg Love is PATIENT, love is KIND, LOVE never fails / DB since 2001