It sounds dumb, but when he says "can I come see you and the baby?" I'm scared that if I say no or say I have plans, he's gonna get angry and then decide he doesn't want to be with me. I know what you're gonna say already - if he says that, then why do I want to be with him?
No, we all know why you want your marriage to work.
What we'd say is that if your H wants to repair the M then one conflict of schedules won't make or break that. If he wants to R you'll know it. But he has work to do as well, and you can't make up for his lack of interest by pursuing him. Learn to love limbo. It can be done. Being appreciative for what you have is the key.
Me:38 XW:38 T:11 years M:8 years Kids: S14, D11, D7 BD/Move out day: 6/17/14, D final Dec 15