LTH, I do not think you should be pulling back AT ALL.
IMHO, you are doing exactly what you should be doing, and it is working. You can not rush a turtle. He has told you in no uncertain terms that he is not playing the field and certainly does not appear to be exiting the M at this point in time.
WHAT YOU ARE DOING IS WORKING. Keep doing it.
If you are going to change anything, think about what you could be doing to get your career onto its new path.