I agree with kml. It is ok to ask. Keep it pressure free and see if he would like to join you.

Feelings are fleeting.
Be better, not bitter.
Love the person, forgive the sin.