Pinning your D's behavior on him is pursuing, I would let that drop for now. The subtext is "If you come back, D will get better" which makes him responsible. He will retreat from that feeling and/or resent you for it.
I understand what you are saying. He did defensive and make a comment something along the lines, "so you are saying that we should get back together for our D sake." I didn't see it when he was saying this at the time. I told him no, that is not what I am saying. I really didn't mean it that way.