It's YOUR parents' house, so I would think that everyone would expect you to be there. If you don't want to be with him, uninvite him. You have more power than your daughter. Or you should.