My husband's sleep time was his pet peeve too. He goes to sleep at about ten, and I am up until at least 2. Our house has all tile floors, so sound is very loud in here. I used to watch tv with him until he fell asleep, and then go out of the bedroom and do other things. But I would leave the bedroom door open because I don't like walking into a room with a closed door. Then the dogs would bark, or my son would talk loudly, and H would wake up and slam the door hard.
So I had to start showing that I cared about his sleep. I always shut the bedroom door now. And luckily, my son has started to go to bed earlier too. So it's just me on the computer at night, which is pretty quiet. Anyway, as long as I seem to care that his sleep not be disturbed, we get along alright.