He's chosen to leave the M home. He cannot just swing by whenever he sees fit especially if he is not contributing to the household expenses. Change the locks or send him a message that he needs to arrange times to come by and see S or he can pick S up and take him somewhere.