Only you know if you're done and you're a glutton for punishment. I must say that you asked for exactly what you heard by going there. A) He wants to sleep with you. Many relationships start as nothing more than physical attraction. Do you want to sleep with your daughter's father than abused you? I think not. b) You believe everything he said. Don't listen to the words. See the actions. He talked for 1 1/2 hours about personal stuff, he included the mistake of the OW, he complimented (essentially) your improvements.
C) My feeling is that if you are willing to accept that it will only be sex and don't get your expectations up, that you make the most of your time with him. If that includes sex then so be it. Live it up.
D) Accept that there is a good chance that you'll never be back together and be happy with yourself either way. He does not have it within his power to bring you down. Only you can do that.
I'd suggest next time you talk to nonchalantly say "sure, I'd love to have sex with you" and take it from there (if that's what you want to do).
In the end, it's not the years in your life that count. It's the life in your years. Abraham Lincoln
It is hard to fail, but it is worse never to have tried to succeed. Theodore Roosevelt
