Can't you just put his mail in a big envelope and send it to him? Why give him another opportunity to contact you?
Quote: The phone rings again after a few minutes. The expected backlash because H hasn't got his way. I don't pick up.
Why not just tell him later that you had left the house after the first call? Why let him know that he means enough to you for you to deliberately avoid his calls - that implies some emotional connection. Just claim to have been out.
Oh - and someday, maybe you could arrange to have a man answer the phone when H calls?????