This sounds kind of like the book After the Affair by Janis Spring. You may find that book helpful, especially if you can get your husband to read it too.