That interaction at the house to me sounds like what I do when I want previous bad stuff forgiven and forgotten. Act like nothing happened and nothing is different. He doesn't want to be just your friend unless by that he means "friends with perks" (friends and sex). I DO NOT enter my 1st wife's house at all unless specifically invited in and I do not make myself at home. That's more something I might do with my current estranged STBX wife that I love.
I would take his interaction to mean he wants to reestablish what you had prior to the setback. He's trying to see if he can just glide in the easy way back to what you had. I agree with Dogma about boundaries. He needs to actually verbalize he's sorry and tell you what he wants out of your R.
In the end, it's not the years in your life that count. It's the life in your years. Abraham Lincoln
It is hard to fail, but it is worse never to have tried to succeed. Theodore Roosevelt