Have you ever talked about this with him? It would seem that he has a problem with long term fidelity. I would be curious to know how he thinks he has changed vs. the guy who tried to "steal" you away from the boyfriend.

Interesting aspect of your situation..