Puppy has a point Ashlee. If your H thinks you are "punishing" him by withholding sex.....then he'll sulk, pout, get mad, the whole nine yards.....however, if you let him know that you do not find him attractive.....well....that is another matter, entirely!
It is not about what you feel should work in your M. It is about doing the work that gets the right results. Do what works!