I'm sure that if you were nice and didn't mention it to him, it would be swept under the rug again. If you are absolutely sure that you want it over and done w/then maybe it's time to move forward w/the divorce. Of course, you will have history w/him from the past, but also he's going around in the present and future because of sharing children.

Whatever you decide to do, we will support you.

Sit quietly, the answers will reveal themselves when you least expect them to.
The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.