I so completely understand. Be firm with him. Tell him what you want. If its a divorce then tell him. If it's to make up his mind fine. Tell him what you are willing to do. Tell him no more cake. Tell him to get in the game or go home (my old hockey coaches favorite term - he'd be proud).
Then say if he isn't going to decide one way or the other you'll make the decision for him because it's your ball and your game and he needs to play by your rules. Then you can tell him about the lawyer if need be.
But make this about what you want. Not what he wants. You own your own life. Take a stand.