Ouch. Reading your story made me cringe. Partly because I have been guilty of "feeling up" my wife when I thought she was awake (at least partially) and consenting, and it turned out she was actually asleep. I apologized profusely but I don't know if she believed me or not. Is there any possibility that he thought you might have consented? I say this because, as I started to touch my wife, she made sounds of enjoyment, and her body clearly was responding. I reacted to the sounds. Mainly because the sound I usually hear when I touch her is "NO!", but that's another story. Anyway, I just wanted to ask you to make sure if he knew you were asleep, or if he thought you might be at least partially awake and consenting. If he knew you were asleep, then that's really bad. As for what to do next...I think I'll let somebody else chime in.
