I do think he has a right to count the debt toward any final calculations, and I do also think he has a right to know -- one way or another -- what you want to do. Does that mean you have to drop what you're doing, jump thru a bunch of hoops, and let him know just as soon as he wrote you that e-mail?
Nope.
But how long has it been now? Two weeks I think??
Whatever it is you want to do is fine by me, and I think we all respect the grace and fight you've put up here. But even if just for YOUR own sake, I do think you need to decide something.
Which leads me to my final thought for now: I think if what you "decide" is to just start having a date here, and a visit there, that you're going to be going right back to a fuzzy limbo that YOU will not feel at all good about, now that you've become "the New Pearl." What he seems to be proposing is a slippery slope into Limbo Hell.