I've accepted my part in our problems, specifically my insecurities and my need to always be right. I've realized that being happy is more important than being right, so now in our interactions if he says something thats factually incorrect, I just ignore it. I've been actively working out since, this helps with my self esteem and I'm trying out new activities.
He does have some anger issues, while he's never been violent towards me, other than shoving me once. He often feels that he's being disrespected by people, and this angers him. I'm sure he often felt I disrespected him and this must have been difficult since he has his own insecurities he deals with.