Yeah, you need to tell him there is not need to talk anymore unless its an emergency.
No more questions about colored pencils, what to make the kids for dinner, why does a bear sh!t in the woods...
This is how he controls you. You need to tell him, Red. Tell him no more.
The only time he should call is if one of your kids is in the hospital. Or if he can't pick them up that day. THAT's IT!
He is no longer allowed to ask what you are doing, who you are with, why this, why that. He lost that right when he decided to cheat.
Until you stand up for yourself, I see ZERO chance of him coming back. I'm not trying to be mean, I just want you to see that unless you change the dynamic, he has ZERO reason to change.