If he doesn't know what it would take, that seems a sign that he is not thinking about it at all. His eyes are focused elsewhere. He is not looking at the house with you as a potential direction, and wondering "how do I get there?" or "what obstacles would I have to get around in order to get there?"

Instead he is looking elsewhere, or maybe nowhere at all.

Inviting him back, asking him "what's it going to take?" is pressure.

As GG says, you have to decide what you want.