Obviously you haven't forgiven him for his transgressions. If he is remorseful, and has made an effort to make the changes, what do you think is holding you back from forgiveness? I realize forgiveness isn't easy, however it is required to have a fulfilling relationship. Of course if the other party is remorseful.
Also, if you are unable to see an IC/MC for fear of rocking the boat, then you are simply trying to ignore a big issue. It isn't going to resolve on its own. The issue needs to be given some attention. If you don't communicate, how is he supposed to know?
My 2 cents.
Me:45 ExW:48 M:04/97 3 Bombs & 2 ReCons 1st BD 11/10 D Finalized 4/20 D-16 S-14 Going in one more round when you don't think you can. That's what makes all the difference in life.~Rocky Balboa