That's what we deal with. Everything is our fault. We can't do anything right. Blah blah blah. What we have to do is understand the part we played and deal with that. Once we deal with our part, then we will begin to not worry about what they are thinking. Eventually, they will snap out of it. It may not be soon enough for our liking, but they will. And when they do, it doesn't mean they are going to want to work it out. It just means that they know.
Continue to mark the positive interactions to memory and let the negative ones bother you for a minute and move on.
Now, if I can follow my own advice, I will be wonderful.