Give him a call and politely tell him that based upon everything that is going on in your lives, now is not the time to plan a move to TN. Your children need stability.
He is just testing you.
He will respect you if you politely say "No thank you."
Remember... Guys love a chase, make him pursue you. If you play hard to get, it most likely will work.