I'm sure it wasn't easy but it sounds like you held your own. Now that you've told him you won't engage in conversation other than as related to the children, stick to it. This is not the time to back slide. Remember that actions speak louder than words, both his and yours.
I second all of Puppy's ensuing advice. It is good to take this time to figure these things out because it will come back to you in the future. You're still vulnerable to the emotional roller coaster so best to have a plan in place first.
Have a good time with your family this weekend. Take some time to figure out what you want but also make time to have some fun.
If you love somebody, set them free. http://tinyurl.com/2empx2g