I don't think it is so much about using the kids, I think it is about setting boundaries. It is true that he needs to see the kids, but it is also true that it has been his choice to go down this path. And seeing the kids less is part of the path. All you are doing is enforcing that.