I just don't understand the need to continue to punish me for whatever he's punishing me for.
Hoozh,
Your first four words contain the answer to your question. There IS no "understanding" wayward behavior, or at least there is no logical way to understand it. He is basically lashing out at YOU, for HIS moral shortcomings and guilt at this point. As sick as it sounds, YOU are the embodiment of everything he hates about HIMSELF right now.
You hear this in the dialogue of cheating spouses all the time. Things like "Oh, you're SOOOO perfect, aren't you!" and "Your self-righteousness nauseates me!" and "Oh, you can do NO WRONG in anyone's eyes, can you?!!"
