Now isn't the time for talking boundaries with him...he doesn't care. Now IS the time for figuring out what your boundaries are.
I agree, learn for yourself what you're willing to live with and what you won't live with and then apply it to your life and be respectful towards yourself. When you tolerate crap behavior from people in your life you invite that kind of problem and then complain about it afterwards. Easier to just let them be and let them go if they can't stop disrespecting you - this kind of attitude & behavior on your part will generate change at their end. When you respect yourself enough to let go of the people in your life that won't respect you, it communicates to others that for them to be in your life they must respect you.