From what you've said, he doesn't have any basis to actually succeed. He is trying to control you. Have patience in the short term, I really think things will be ok in the long term. Stay calm, or you'll just be helping him. Again, I'll bet he has no interest in permanent full custody, he's just trying to get you to do what he wants.
