Yeah, my wife viewed/views me the same way. She mentioned the other night that when we would be out in a large group, she felt like she had to make sure I was enjoying myself, as if I was a small child at a sleepover!
Sometimes being the nice, quiet, unassuming guy is deadly to a relationship.