I'm sure he felt it wasn't fair you got to live the married life while he was in a dark depression from feeling neglected, diminished, and misunderstood. I'm sure he felt quite taken advantage of. If you are going to keep score or use this as a reason to ask him to leave, I don't see how you are doing anything different than he did when he felt this way and decided to walk.
This is your marriage. Marriages that last 50 years have difficulty in them. You'll need to lose the score card and the idea of a quick fix. Doesn't mean you have no boundaries, but this idea of asking him to leave has got to go. What did DB Coach say about throwing him out? They couldn't be behind this, right?
My DB Coach told me that while my lack of voice wasn't a model for how a future relationship may work, and that clearly there would be a time for me to voice my feelings and needs, during this crisis wasn't the time.
How are your 180s coming along? Anything you're doing to make H feel like he could be fulfilled in a marriage with you?
Me:38 XW:38 T:11 years M:8 years Kids: S14, D11, D7 BD/Move out day: 6/17/14, D final Dec 15