I think it's very wise to hold his feet to the fire and not let him off the hook on this. If he backslides it will telegraph his true lack of commitment to really saving the marriage. Sure it's going to be an unpleasant thing for him to have to do, but it pales to the unplesantness you have endured during this whole situation.