I wouldn't go. Simply b/c you are vulnerable. If you intend to keep working for your M, I think it's too risky. Not only for you, but for him as well. You risk messing with someones elses emotions and if you aren't crystal clear about exactly what it is you want, don't do that. It isn't fair (no, nobody ever told me life is fair). Yes, we are human and b/c we know how tempting it can be to be desired and appreciated etc... we need to stop and think first. Your choice.