XW and I have the kids passports go back and forth. No issues so far.
One thing I made sure to do on my last trip to Canada with the kids was to create a permission letter that XW signed so as to get through Canadian immigrations easier. It detailed out trip and had her phone number in case they needed to check with her.
