We often take OURSELVES for granted.
Your son will love you no matter what. The only advise i can give is don' t ghost him. Talk to him.
If you go, he will be happy and if you don' t , he' ll understand since he' ll know why.

Ps are your other sons going? Maybe having them with you might give you strenght?