Why can't you say it like that? It belongs to you, too, right? Don't let him trample all over you. You have a valid say in what occurs in your property. Have the locks changed. He might say she's his guest, but you have no obligation to play any part in providing a spot for his adultery. How dare he sully a family spot? Ask your L what your rights are in this matter.