Tell him you won't stay in a marriage lacking sex and physical affection. OTOH don't say it if you really want to stay because of the words of affirmation he gives you and financial support etc. Personally, I think that would be a lame deal for you. Lots of guys will give you all of the above.
"Tell me, what is it you plan to do with your one wild and precious life?" - Mary Oliver