He HATES feeling that I'm critical of him. He goes on about how in my eyes he can never get it right, how he's never felt loved by me, that I just don't get him and never will, that he's given up on me ever understanding him, etc... All this to say that I'm wondering if any of you can see how I can 180 some of these complaints.
I feel that he tries my patience and then blames me for getting irritated with him.
The bolded section is the cycle. You must break this cycle. Since you can only control yourself, this means you must stop getting irritated, and stop being critical (in his eyes). Maybe just accept him for who he is?
M: A really long time. Crisis: 5 years. She's still worth it.
Life is never made unbearable by circumstances, but only by lack of meaning and purpose. -Viktor Frankl