I would not take his calls right now. Let him sit and wonder what you are doing. lol

Also he is the father let him take care of your child. He can't run off if you say I need you to watch her as I have something to do on this day. Give him notice about a time and maybe he will step up.