And again I need to stress the parenting plan! Then your wife will know what time you will be back with the kids and you can avoid this interaction because you don't want to come off as controlling just not a doormat.
x 2.
This will be best for all concerned, INCLUDING your kids. In the meantime, you should give her a time when it's regarding the children.