I didn't hear him saying "I don't love you." I heard that he said he enjoyed being with you and doing things with you. There are a lot of guys who don't like feeling like they need to put labels on things. There was just a story online that said, when women ask men "Where are we going..." in a R that the men typically thing the woman is pressuring them for a commitment or a proposal. But the women surveyed said they really just wanted to know how the man felt about them? Sounds like one of those Mars/Venus things.
What answer would have pleased you? Anything short of, "I love you dearly, I screwed up royally, I want to be with you the rest of our lives and show you how much I love you?"
I am not trying to be a witch, I am honestly curious. Because I have done similar things/asked similar things without stopping first to think what I would want the answer to be...