Feyth, maybe someone has better advice or direct experience with this, but I would just say "I need to pick up a few things" and if he brings up moving everything, say something like "I just need a few things right now, we can talk about the rest of it some other time." Or is there any way you can go in and take what you need when he is not at home? He might not even realize you were there.
