OM only wants what he wants. He's the center of it. Your inner conflict, concern about your child and his reaction, etc... well it doesn't sound like those matter to OM. I wouldn't be surprised if he just wanted to "win."
You may not have a perfect marriage (Does anyone? Maybe in the first two or three years...), and you may not have a marriage you want in 10 years.... but trying to at least be friends with your husband, allow your child to have some stability and access to both parents, I really don't think you'll ever regret that. Just take the next 7-10 years to focus on you, and being a great woman any healthy, well-adjusted guy would love to be married to and I don't think you'll regret anything.
There is no arriving, ever. It is all a continual becoming.