I don't think anyone can say what is correct and what is not. None of us were there, and, as hard as we try, our emotions tend to end up on the end of our tongues. But, it doesn't seem you ended up in a fight, and that is good. To me, it seems if your husband really wanted to get out of the house, he'd already be gone.
Detaching is tough when you love a person and have been together so long. Not backsliding is even tougher. I'm strong throughout the week, and a total wimp on weekends.
If you feel good about the conversation, then you probably handled it well.
