Your H is obviously searching for happiness in all the wrong places. When you married him things were different, he was different and so were you. Your love and connection was real. It was not a mistake. Don't ever forget that.
You've grown a lot, and have become a much better person. Continue to take the high road here. You will never regret it, and he will see this when he looks back some day. Don't confirm his decision to leave the M as a good one with poor reactions to his antics. Instead, show him only love and compassion. Allow him to realize that bailing on you was a major mistake on his part. Sadly for him, I can almost guarantee that at some point he will.