I think that's a great start. Boundaries are difficult to enforce, but I think for your own well being it's a good start.
I can tell you from my situation, that you need to set and enforce boundaries that work for you and are only intended for that purpose. Anything else won't last. By setting them for you and for your well being, you will identify and be more ready to enforce them in a kind but firm way. You must enforce them as well else you will be a door mat.
I think it's a great start. Don't be afraid to add to that and know that he needs to respect those boundaries as what is best for you. If he refuses, then you need to keep him out of the house altogether and he can stand at the door while waiting for the kids.
It gets better and easier to set and enforce boundaries when done for yourself only.
AJ
"Our lives begin to end the day we become silent about things that matter" MLK Put the glass down... "Yesterday I was clever so I wanted to change the world Today I am wise, so I am changing myself."