Ashlee, You did very well remaining calm and how you worded it. If you give him an ultimatum then you must be prepared to follow through. You have to also be prepared for h to chose ow over you. Right now he is thinking only of himself.
Do what you need to do to keep you and your son sane and healthy. It is a rough road but be the support your son needs and get yourself some support as well.