If he no longer lives there, you can do what I did with W and politely ask for the key and tell him your concerns. If you don't feel you can, the only thing you can do is wait until the LS.
"I made the wall of shadow draw back, beyond desire and act, I walked on.
Oh flesh, my own flesh, woman whom I loved and lost, I summon you in the moist hour, I raise my song to you."
