Portia, It was nice that he remembered your birthday and you responded back. Maybe you could have said thanks for the well wishes and I miss you too. It would have been simple, but a true response.
In my opinion, which is just how I see things, is that if he truly missed you, he would be in contact w/you more often and be making an effort to stay in touch w/you. It appears that he only comes out to play at a holiday or special event or when he has a moment of clarity. What I do think he misses is your being readily available to listen to his life's story and what's going on his life.
I'm sorry that he appears to be stuck in his own little world. Sometimes when they say ILY or miss you, it's said "off the cuff" and really doesn't have the same meaning to them as it would to us.
You'll get the hang of things as you continue to walk the path on your own journey.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.