Fight, again I don't envy you the tension of him being there. I have a hard enough time when he is so far away.
You are going to have to let go of the need to know who he is talking to or what he is doing. When you do those things he knows you are not detached and that you sitting there on the shelf where you are supposed to be. That makes him comfortable because he has the object of his pursuit and Plan B right where he wants them.
When you do your surprise attack move-out you will certainly get his attention and he will figure out that you are moving on. Until then, try to ignore what he is doing. Trust me I know how hard this is and I completely stink at it myself. I'm still taking the bait.