Thanks for those potential responses, Blackie. Unfortunately, he wasn't asking me because he truly wanted to know my answer; he was trying to prove that there isn't a "time" in the day that works for both of us. He can't stay awake at night and I do not like mornings. I have, however, given the green light for mornings but so far he has not taken me up on that, except for weekends.
We did used to do it a lot in early evening, before we had kids who are awake at this hour. I'm sure that we will fall back into this mutually satisfying pattern as soon as our kids are grown.