I don't think you should give up and walk away, but I do think you should insist on "no contact" and full transparency before you and him try again. If he does not do this, anything you "try" now will be worthless because he won't be in it all the way. he doesn't realize this, but it is true. Many times when the LBS stands up for themselves, there is a turn around from the WAS. You need to respect yourself and expect respect from your husband as well.