Your teens are already expressing pretty strongly how they feel about seeing him. But it seems to me that somewhat like WAS they are going to pull away the more he pesters them. If it's important to you that they have a relationship with him then maybe establishing a schedule will take the pressure off them to respond at his will and give them a bit of space to calm down between contacts. They may still resist him, but having some predictability to their contact with him will reassure that they are important to him and eventually they may thaw.
How you can suggest this to him is difficult given the state of your relationship at the moment, but perhaps your kids can come together to make an agreement among themselves?
I'm so sorry your family is going through this. I hope your kids find peace soon.
Me42, H40 D12, S8, S7 A revealed: 7/13 Sep 4/14; Agreed to D 1/15