so does the contantly reading into things ever stop?
Hmmmm...I'm wondering what you mean by that? Is it just a question or is there something deeper?
It's simple. He called you, and he sounds ok. You call him, and he sounds distant. Answering the phone is never pursuit. Calling him can always be interpreted as pursuit. Solution: don't call him (unless you have a kid in the ER).
Of course, people always make calls when they have a free moment, but (unless they are sitting at work staring at the phone, willing you to call) they are more distracted by whatever they were in the middle of when you called.