I'd have to agree with what everyone else has already said. Don't be lured into spending time with H if you're having difficulties with detachment. At the same time, you need to focus on what is best for your DD -- and right now getting Mommy to where she is safely detaching from Daddy is more important for DD in the long run than one instance of swimming with D when H is present.
