You are exactly right, the fixation on him will hurt you. He is a symbol of the hurt and problem. Try to avoid watching his movements and actions and do something for yourself. I found it so hard to try to do something else, by myself, but after I tried it got easier.