Does he call you, or you call him? If it's you calling him, then maybe try to wait and see if the convo is different when he calls you to initiate convos.