Working with him seems to ease his desire of time spent with me... just like I worried about. I am really trying to be pretty strict with my business mode and not discuss "personal"...however, he does bring up personal convo during "work" time... trying to be social.
You seem to think the above is a bad thing.
It isn't and it's quite normal for the MLCer to try to remain connected and use what ever means they can to get what they need.
You can certainly go ahead and refuse his need.
You worry that he's going to go have an A. He is less likely to seek it if he's getting what he needs in that respect, from you. No matter how much you don't like that you aren't getting your needs met, right now, you are setting the ground work for possibly saving your R and having your needs met in the future.