Sam,
Sounds like your on the fence about the sex thing, but you seem to be leaning towards not having sex. You have to follow your instinct.
I think if I were in his shoes I would be thrilled to get to first base. I guess the best advice I can give is take it slow and dont let your emotions rule your actions. I know easier said than done.
Hope