I second LR above. Except I'd go jokey instead of pointing the finger at him. I mean it's true and all: what IS he doing about his issues? But pointing it out will just escalate him.
Discussing changes seems to just provide him with an opportunity to lord a negative (and incorrect) opinion over you. Just because he has trust and negativity and fear issues now from his own pre-H4L life and your past R doesn't mean you haven't changed or that you today have to absorb his fears and jibes.