SW, Totally agree with the posters above. Most likely is totally innocent (not being glib) "guys being guys" crap.
My concern for you, however, is that you need to work on improving intimacy and communication in your marriage. The very first thing you need to solve together with your husband is your schedule! You shouldn't be living what is essentially separate lives. You are becoming roommates. One day, either you or your husband will wake up and feel the "spark" is gone. Consider this as an early warning for you to make big changes to your life now, before you end up like others on this board.
Many, many folks make the same lifestyle mistakes that you are making, all with the good intention of doing the right thing for their family. Ever hear the expression " the road to hell is paved with good intentions"? You and your husband need lots of time and open, honest, conversation together. If your relationship was in a great place, you could ask him directly why he doesn't want to be "intimate" more often. Then you could work to solve that issue together.
