He was put off when you got home, not because he had a hot date, but because he was concerned about you. You hadn't set a time, but it was later than he expected. He had a time in mind, and was tortured every minute thereafter until you arrived. He couldn't call to ask, but perhaps wished you had called to let him know. Top it off with the fact that he hates that he still cares, because it confuses him.
As for next week, perhaps he has a golf date Sunday, and perhaps something more special Saturday night. You don't know, and you don't need to know. He may very well have switched it around just to make you think something was up.
