Done it! I sent pretty much what I wrote above and ended it with "Sorry, I thought I could but I can't do tomorrow night."
He sent a sad face.

And now I'm in tears.
It just shows that emotionally I am not ready.

Thank you again Scaredsilly for validating my feelings.
Tumbling