Talk me down because I am shaking. Not sure why this panics me but it does.

Text conversation:
Exh: Did you leave baby last night?
Me: Yes, for a bit.
Exh: Too much to call me and ask if I wanted to watch her?
Me: It was last minute and my kids and sister were here.

I don't want to point out the fact that he has supervised visits. So what does he care about? The fact that I left baby for the first time in months?

Me: 46 FWS: 36
Married and Divorced 4/07, Pregnant 7/07,False R 7/07
Baby Girl born 3/08
Kicked him out because OW: 7/08
5/10 He realized what he had and lost.
Moved home! REMARRIED 3/14/11!!