I don't know the whole story, but why not try asking him to dinner or over for a movie. Sounds like you don't want the relationship to end and it sounds like he wants you but is afraid to overtly admit it. Just a thought sorry if this has been tried already.

regards

Married:10 years
D final 8/28/08 10 minutes is all it took
Life goes on and DB was no small part in growing from the Divorce!