WR, Here's the deal...do you want him in the house packing? Do you want him in your space right now? If not, then pack up the sweaters and his coat and have them ready to give to him. I wouldn't be mean and "forget" his things.
It's your decision as to whether to have him come there and pack or not...you know how you would feel if your space was invaded. However, if you do allow him into the home, please be sure to put all of your papers, etc. in a safe place.
Sit quietly, the answers will reveal themselves when you least expect them to. The past is gone, the present is a gift and you need to focus on today, allow the future to reveal itself when it is ready.