Oh boy, my H has pulled that stuff too. I find it works best if you just ask him not to say a word when he initiates. Asking just kills it so often. Maybe it's the baby voice, maybe it's the hesitancy, whatever.
Isn't it already a given that sex is the follow up to "hand on the clit?" ???
Why do they need to do that?!