Instead of deciding whether he should continue the marriage, shouldn't he be seeing if he is able to repair the marriage and have a happy one with you? He's looking at it all wrong. If there is anything you can do to get in some pro marriage counseling together I would do it.