Exactly. He's keeping you on the hook and hides behind his anger.
I think your best bet, is to tell him no more texting. Send him an email with EVERYTHING lined out regarding schedules, visiting times, logistics etc. Consult your lawyer before sending.
And finish the letter with, please refrain from contacting me unless its an emergency.
I think you do need to stay NC. Not only will it help you, but I get the feeling it will shake his confidence.