I agree with Walking. He needs time and space to miss you. So, don't let your heart give in ... say 'no' to his wanting to get together as a family. It's all a charade anyway. He's allowing your D to think it's okay to have OW, and also family. This is not the example you want for her.
Take care. I love the oak tree metaphor.
Me:57 H:52 M:28 Got another lawyer last year and filed. D35,S/D twins28,D22 EA4/04 End? Who knows? "Life is like a mirror. Smile at it and it smiles back at you." — Peace Pilgrim