"She said maybe by the end of this year her and my daughter would move to California and I can just come and our daughter whenever I get the chance."

Reynaldo, I'm not sure about your state, but here in CA if my wife left me or I left her either of us cannot move to another state. Fight for that, Wifes, husbands they can be replaced, but your daughter is your forever. Think about it.