I think he is trying to initiate small talk, it's a good idea to always have somewhere to go or be. Take advantage of the childfree time, have some GAL plans each and every time (even if it means just going to the cinema or reading in a bookshop or something) and have your coat on and bag ready when he comes to the door. 'Hello H. I have some things to do today so I am going to leave you do it. Lunch for Baby is on the stove. See you at 5!' and then breeze out in a gale of perfume and with a cheery wave.
Even better if he takes your daughter to his own place, and you just have her ready with her things, take her to the door when he knocks on it, give him any information he needs, then get back in the house. You can be brisk and friendly. 'Hello, H. Baby has been looking forward to seeing you. Change of clothes in her bag, and she had a late breakfast today so might not want her lunch at the usual time. Have a lovely afternoon!' *close door*
I think it is going to be impossible to really go dark if he's in your space and you'll both fall into old habits of playing happy families then resenting each other for it if it continues too long. Ask me know I know this...
