You did nothing wrong....why do I get the sense you feel like you did?
There are many different ways to go about this and that stragety may change day to day.
If he's there and being nice, enjoy the interaction. Only a crazy person wouldn't want to enjoy a nice quiet time with loved ones....so no worries. And yes, that's an opportunity to show him life can be a partnership where things are nice and calm.
You have ZERO idea of what happened between him and the therapist so don't worry about it.