OMG - echo FM. What that man did was SEXUAL HARASSMENT. Which by the way often feels like it is your fault. It's confusing and numbing. Please please please call 911 next time that man says anything or if he follows you again.
Acutally, you could make a police report as well as file sexual harassment charges at your job. If he doesn't do it again to you, he for sure has done or will do it to someone else.
Coming to your house and trying to get in your bedroom - he was stalking you. That is scary.