So, why are you worried so much about his reactions?
Do your best to let them bounce off of you. He does not have control over you. He does not get to demand how everyone else's life is going to be because of what he wants.
If you 14 year old doesn't want to go there, then he doesn't want to. They found out within a weeks time that you guys are getting a divorce, their dad moved out, and they will have a part-time home. That is a h@lluva lot of transition and I don't blame your S for not wanting to go.
You are the advocate for your kids. I honestly wouldn't give two f*cks what your H wants or thinks or how he is going to react. Only proceed in a way which is best for your kids. And S14 is already letting you guys know what is best for him.
You don't need to fear his reactions anymore. With you as their advocate, I know your kids will get through this and you will be so much better off.