DU, I'm sorry, but you now need to toughen up just a wee bit for tomorrow. So, the man wants to come over, well...let him. Why don't you have someone come over for a nice little visit while he's there? Also, you need to be home when he's doing that inventory. Take photos of everything so that you have proof that the item was still in the home at the time he paid you a visit.
I hate to say this, but you can't put his visit/inventory off much longer...he's got a one track mind and until he's gotten this out of the way, he'll keep talking about it. The one thing you will need to do and that is to look at this as a business deal, put your heart in the closest while he's there. Try to think of this as the American Road Show for estimates on goods. Get your clip board out and be ready to roll w/him. Do not allow him to bully you. This will be difficult, but you have got to stay strong...cry after he's gone, but not while he's there.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.