If you can work on the detachment, the confrontation, if/when it comes will be easier to handle. Its better to try not to take things personally. Remember, if he is as narcissistic as you think he is, it is all about him. It isn't about you at all, even when he says it is.