You're back to "he's nice" for the moment. What do you think will happen next?
He hasn't shown you the ONE needful thing: respect for you by getting rid of OW from his life, completely.
And even if he fires her, you are going to need assurances that he isn't sneaking around talking to her or seeing her, which means complete TRANSPARENCY in email and phone communication.
Do you think for even one minute he'll accept that and let you check on him?
Given his recurring behavior I think he won't.
And I think you'll never rest easy unless he shows YOU a 180 degree turn. He hasn't even moved a couple of degrees.
You said you want him to start treating you better.
Really? Ok try this on for size...
This is what you convey: fire the OW, never contact her again or recieve contact from her, and provide complete transparency of your phone and email records so that I can trust you. Oh yes, and move back in.