I believe he is pushing all your buttons now. He sure knows how to get to you. He doesn't want a divorce? What's he willing to do about it? Retrouvaille? counseling? Or just pushing you around?
He doesn't want the kids 50% of the time. He wants to upset you 100% of the time.