TOH , you didn't say what you meant by him threatening you. Please explain further. Is he threatening physical harm to you, to the property, etc. ?????
You can't predict what he is going to do next. Do as Naej suggested and not stay there alone this weekend.
I would also suggest that you write down everything that was said at this confrontation and relay it to your attorney. It may come to the point that a restraining order may have to be put out. I hope it doesn't come to that, but your safety and well-being, and that of the kids is the most important thing at this time.
He wanted things his way...had it all planned out...and then you took your life back. As Naej said...it's about control at this point. And he will try to control you again, so please be cautious when dealing with him.
Please take care of yourself, and plan on how you will react if he starts to stalk you (or has someone else do it).
Women are angels. And when someone breaks our wings, we simply continue to fly...on a broomstick. We are flexible