In fact, ask XMIL in front of him - "Hey, XMIL, exH and I have some paperwork to deal with so that I can buy him out of the house - what's a good time for him and me to do that and you to entertain granddaughter while we do? Maybe you could (bake cookies, swim in the pool, whatever around the house) while we do that. "
