If you're not feeling on top of your game, then you don't need to make any big decisions right now. When he asks you stuff like that, just say "I have a lot of decisions to make," which simultaneously buys you some time, and also shows that YOU are in control -- not him.
btw, big KUDOS to you for turning him down for sex. What an insult!!!
