I'm not a vet by any means, but it only makes sense that he would get angry. He wants it all and by you stopping the pursuit, it's not following what he wants. I think that you need to continue to stay strong and do things for you. You can't control his reactions, so it isn't your fault that he chooses to get upset.
I think your head is in the right place. He needs to miss you to really see what he's losing.