I also need to give myself a break from seeing him.
I think this is the more important reason. Good for you. Give yourself a chance to heal without revisiting the wounds each time you see him.
Do you need to lock yourself away in your room? Is he just coming by to pick up the kids or does he come in and stay? If he is staying, can you get out of the house to do something fun? Make it "you" time, a recharging period.
W 34 Me 42 Married 7 years together 8 0 kids 1 beloved dog BD 4/6/2018 I moved out 4/7/2018 I moved back in alone 8/05/2018 I file 3/06/2019 D official 5/7/2019