What if on the following day the sight of a good-looking swimming pool made your heart skip beats with excitement and caused you to fantasize about just how delicious it would be to jump in? See, I think that's where we differ. It's not logical -- our "reasoning" here is driven by our hormones, not our intellect.
Your explanation sounds more like my wife in the best of times years ago. Sure, it was fine one day, but the next day -- "Well, gee, we just did it yesterday!" That answer felt like total rejection to me at the time. Now I'm used to it.
I would agree with your "reasoning" to periods within a day. If we had a good session in the morning, then I could often feel that it was good for the whole day. But the next day, and certainly by the second day, everything is a "reset" for me.
