It is where you are living. So, tell him what you meant. Trust him? MMMMM maybe, maybe not . Why are you concerned about him being there when you are not ? I'm not challenging you. I would feel the same.
When you can't make a decision because you are torn between your heart and your head, listen to the half with the brain.