I think you can stand up to SBTXW and tell her that given her past actions, you would not be comfortable with having her coming around your backyard and that she'll have to make other arrangements with the friend to meet elsewhere. That is boundary-setting for YOUR own well-being.
