I think he already knows you know. Who else would have his phone? is probably be what he is thinking. When you go home it is very important to stay calm, so not to freak your daughter out. If he turns evil, just call the local PD and have them escort him away from your home. I had to do that to my ex. Or have your family go with you to make sure nothing bad happens. TImes like this are scary. You are hurt and you are not sure how to move forward but you have to for your own sake and your DD. Good luck and you will survive.
