I hear you TwinDad. I'm just now coming to the end of my first week solo with the kids. I have always considered myself a good dad, never have an issue with taking care of them and love them dearly. The week was hectic, but only a little more than it would be with both of us in the house. The typical after work drill is pick them up from school, get a snack in them, get them to activity, get them home, make dinner, do homework, get them to bed. The most leisure time we've had was Monday night after dinner when we went for a walk around the block.
You are correct that it is that much more rewarding when you have someone to share it with.