I think you did fine - you let him know that you know what was going on, and you set an appropriate boundary in a gentle way. He may run, but it won't be for what you did... you did just fine.
PS I love your name, after reading the "why'd you pick your name" thread, I love that you have questions and aren't afraid to ask... those people that stop asking grow old and die quickly, IMHO.
