You've now known about the affair for 4 months. In my opinion, it's far from too early to employ the tougher stance. We are all different, but I myself wasn't able to tolerate more than TWO months of my wife's unrepentant affair before I finally was DONE, began dating, and filed for divorce.
Within one month, she ended her affair and asked what it would take to come back to the marriage.
