I told him so and he responded that he had been trying to be patient and trying to help me but it didn't seem to make a difference so he was going to accept that I don't want to have sex with him but that I should take care of him when the need gets to the point where he has to have it.
There is the possibility--not certain at this point,though--that you will have to face a choice between accepting this as his best offer or walking away. Would you accept this kind of marriage? You would have to decide.
I wouldn't be willing to live with that, but it took me a long time to work up to the point where I was willing to sit my wife down and tell her that. It's scary, but liberating.