Can you ask for space? Could you say something like,

'I want you to make a free choice that you come to without pressure from me. I want to be able to do the same. For that to happen I need space. The best way of showing you care for me and respect me is to give me the space I need and the time I need to come to my own decisions.'

I don't doubt he cares for you May, but he cares for himself more - and what he wants is for you to 'stop the apathy' because it makes him feel bad. You're not punishing him, you are facing facts, believing what he says, granting him total autonomy and looking inside. These are healthy things. You have a right to them. When he refuses to let you have that, take a long while to think about why that might be. Who does it serve?