It sounds like he's feeling hurt and defensive and justified and all sorts of other things that he's using to make himself feel better by making you out to be the bad guy.
That doesn't help you, but I've been guilty of some of the same things. And it won't make you feel better, but my girls love riding with daddy in the truck too. But they go EVERWHERE with me, and daddy is a novelty.
Each experience in life has formed me, become part of me, made me stronger.