Ya, i would just tell him outright NO DIVORCE right now
You could tell him if he even LOOKS at a divorce paper right now and puts your children at risk he's going to regret it... I really think you should have a friend there or something to temper his bullying you into divorce like this.
This isnt' just about how HE feels, its about those children too and he's not putting any thought into that.. and someone has to.