I wonder if he is refusing to leave because he thinks you want him to leave. He may think that if he leaves he is letting you control the situation. He does not want that at all, he wants to be in control.