In my opinion, I would not go with him. You are right, he wants his cake and eat too. DETACH!!! Tell him that you have plans, even if you don't.
A couple of weeks ago, I was at my H's apt. After an 1 hour there I said I have to go and I left. About 20 min later I received a text asking why did I leave so abruptly. I told him that I did not but had to meet a friend. I didn't. I went Christmas. I wanted him to think that I had a life and I am not sitting around waiting for him. Well the next day, he was curious and asked about my friend. I smiled and said I had a great time. Well, he started to pursue me. I spent Christmas Eve thru this morning with him and we had a good time. But the entire time that we were together, I did not pursue him at all. He did make some advances towards me but I had him at arms length.
