The reason why he has a hard time with the girls is because he flaunted his affair right smack in their faces back in 2005-2006 before he moved out.
At the beginning of this he told the girls that all of the kids were unwanted, etc. amongst other things.
He now knows what he said/did and I think it hurts him deeply and has never been able to maintain a close relationship with them. Let alone forgive himself.
The Bomb: 08/05 H moves out: 06/2006 H moves back: 01/07 & Out again: 01/07 H moves back: 03/08 & Out again: 04/08 H moves back: 05/09 & Out again: 07/09 Divorced 08-12 Kids: 22, 20, 19