How is it that he dropped by unexpectedly? I would nip that in the bud. "Please call first."
Last thing you need is to start feeling nervous in your own home about him "dropping by." That's your sanctuary. No A$$holes Allowed. Maybe put out a sign saying this on the front door?
"You know, it's times like these when I realize what a superhero I am." Tony Stark/Iron Man
“Focus on what you can do, then do it with all your heart.” Lois Wilson