Quoting Corri: I can't tell you the last time he called a sitter for us to go out on a date. Now, can I do that just as easily as he can? Of course. But it's the effort that counts with me...that speaks to me. Not necessarily the date itself.
Have you read the Five Love Languages? Its a powerful book of simple concepts. It sounds to me like your husband is not speaking your love language which is "quality time". Try to read it together as you did with SSM. It will be good.
Have you told him how you felt about this issue. Sometimes keeping quiet and thinking "But he should know" doesn't help because he can't read your mind.
Gosh, its equally frustrating to be on the other side of the fence isn't it especially if you're trying but feel like your H is not trying to understand you. I totally agree with you that there has to be giving on both sides to solve a problem.