I wish I could give you some sage, calming advice here, but the truth is that this is the aspect of my situation that I struggle with. Having the other woman in any kind of familial role with my children raises a lot of primal emotions with me, and I have not found a way to deal with them successfully. It's not a good feeling when they leave with their father, knowing where they are going.
Does your XW have any female friends? Is she confiding this all to D22 in a BFF kind of way?