Another point to make, I'm not a violent person either, but there have been times I have imagined what I was capable of doing if I were face to face with him. This is from a person never even in a fight as an adult.
So Kembob, you know he wont be remorseful, but how would you react if he threw the A in your face and actually gloated about it? You have expectation he would be intimidated by you speaking to him, but you really don't know what hes thinking either. He could honestly say whatever he wanted to you with dad walking over in the background.
Accept what is, let go of what was, and have faith in what will be