There is no way to predict what he's going to do at this point in time. Try not to borrow trouble before it happens. Prepare yourself for the worse and hope for the best. You are allowing this man entirely too much head space that he isn't even paying to rent. You are giving him too much power in your brain.
One other thing, that stuff he's telling the kids may be just something he wants to get back to you. He knows that the kids will tell you what he's said or done. I would take what he's told them w/a grain of salt at this time.
Keep the focus on you and your children.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.