I would say "It's not what I want, but your father has made his decision ". Then move quickly on to how you both live the kids, and that won't change.
Also - be prepared for the kids to act out in the future ON YOU. This is because you are the safe parent - they can vent on you without risking losing you, while they don't dare vent on H.
