If it's anything, I too had those same feelings. My children, at the age they are, took to the transition better than I thought. I think as the LBS, I may have made things more accommodating for them when the kids were with me on my week. It was still tough. I did consider getting professional help for my younger son, but things are turning out for the better.
You're doing a helluva job taking care of what you need to.
I also believe you will find a lot of relief when you are physically separated and you will continue to make the best of it and be a great dad for your kids.
H 49 , W 47 T 23, M 17 S11, S5 BD: 7/18 IHS: 7/18 - 3/19 Physically Separated: 3/19-4/19 Piecing: 4/19 - Current