Yeah, you could just tell him that you are free tomorrow if he wants to meet up.
The part where he says he "wants to hang out and see if there is anything between you" makes me worry about levitating shirts. I don't think you should go there this time.