Jo,

Then tell him. Tell him you deserve respect and consideration as well.

And tell him to quit contacting you with silly reasons, unless he really wants to talk.

I promise you, from the male perspective, he has NO idea why you are upset, if you are showing any anger toward him.

He might get angry with you, but at least you will know you were honest with him and yourself. And not getting frustrated for what appears to be no reason to him. And making yourself sick holding it all in.