EEEEK. That would totally wig me out. I think setting some boundaries would be TOTALLY within your right. And you can do it in a roundabout way.
Something like......"Wow you really scared me the other night. Now that I'm alone in the house with two small kids, you are lucky I didn't come at you and attack. For my heart and your safety (enter laugh) can you please call and ask first if you want a late night visit".
Honestly, he could be TOTALLY in "man mode". Wanted to get some, and wasn't even thinking. But that is sort of freaky, and would definitely address it.
Chris
__________ Me:39 H:39 D:8 D:4 M:9 (T 13) Bomb 4-5-08, H moved out 6-16-08, Reconciled and H moved back in 5-31-09 Still doing GREAT a year later!!!