I cannot even imagine. Send him an e-mail that you will be making birthday plans for YOUR family (which no longer includes him) to celebrate with your son and he should do the same, as you will not be celebrating together. End of discussion!
"You can't stop the waves, but you can learn to surf." Jon Kabat-Zinn