In the end who are you more interested in pleasing, yourself and your H and the grown kids to a lesser degree or the other family members who might have a "caniption".
It's you and your H that come before the rest in my estimation. You took vows to spend your life with him not the others. Themz are my thoughts.
I hope to be facing the same type of scenario soon enough but that is altogether unclear as of this moment. At least to me anyway. As always I will be the last to know.
Be well and let the Lord continue to do His work on you and your H.