Lots has happened since I last posted! I think what you suggested about not contacting him is helping a lot! I actually ended up telling him I didn't need him on Saturday, since I already had plans with the kids to go into the city. He text me that night and asked how it went and I said we had a great time. I didn't contact him all day Sunday, and he ended up replying to an email I had written to him a week ago. My email had said how I just wanted to tell him all of the things I was greatful he had done for me in our relationship....helping me when I had a mini mental health crisis, helping me through 10 yrs college, and supporting our family financially.
So he writes back how its tearing him up not being with the kids and not seeing them and stuff. I'm not going to get my hopes up at all because it never once mentioned missing me, but still I think its a positive sign.