Well, what will make you most happy, without even considering his happiness?
Perhaps get him to watch your baby, at least they can bond. Want-away Fathers normally lose their love for their children. I have not spoken to mine in 3 years!
Just cos things are going right, doesn't mean that they were always wrong.
