Pregnant w H who doesnt want it and had affair

[Mom22]

What to do

This is my 1st time posting and I really need help. My question is at the bottom. Its like a soap story so sorry for the long post...

Before my H and I got together, I told him I wanted kids and this was a dealbreaker to me for starting a relationship but he said he wanted a kid too and 2 was ok just not 3 (his ex had 3 kids from a previous relationship).
A year and a half after the birth of our daughter (whom he dearly loves) he started to backtrack on no 2. He's got some serious ocd's and might have a mild form of autism and/or adhd, so he cant handle chaos or busy-ness well. I get that. But a 2nd was part of the deal. My ovaries were literally all over the place.
I pressured him and tried to convince him for a year. One night we did it w/o protection and I got pregnant. He warmed up to the idea until we found out it was twins. He said he couldnt survive that and neither would our marriage. But he would actually like another baby so if I aborted we could try again AND work on our marriage (he felt unheard and distrespected because of my pressuring and tho we had regular s** he wanted more experimental stuff than i was comfortable with. He said I was tired a lot and too busy w our daughter and not enough w him so we were having problems).
I did the abortion to save our marriage and family but regretted it immediately (religious) got depressed after and was very sad and negative and blamed him partially. He was already gone 3 nights a week before the abortion but after he went on a party spree (dance lessons) 4-6 nights a week. About 4 weeks after the abortion he started an affair. I didnt find out till 3 mo later. During it he backtracked on trying again. Later I understood why.
I confronted him in a controlled manner about the affair (unprotected s** too) and tho he was very unapologetic he agreed to end it and work on us. But before working on us first he needed space. So he kept dancing, 5-6 nights a week to calm down. OCD's....

After the abortion my body didnt recover. During all this I was being investigated for infertility and it was said I could surely not get pregnant soon (maybe never). A month after discovering the affair I discovered I was 4w pregnant again.

H went totally off it. I said I cant abort again. I would become more depressed, didnt believe it would save the marriage anymore and most of all I felt it was morally wrong.
He feels distespected by a decidion he does nog support, had no say in and a bsby he doednt want. For the rest of his life.

Ever since we ve spiralled down. We havent had s** since beginning Nov.
He finally agreed to councelling but 3d before (a week ago) he dropped the D bomb.

He says he cant do it anymore, he's been miserable for a year now and he doesnt want to split up our family and loves me but not like before. And he s too hurt and angry that Im taking part of his life away by refusing to abort the baby and he's not attracted to me anymore and thinks it ll never work cause Im sexually not adventurous enough and he isnow finally getting female attention he missed when he was younger and he wants to enjoy that with women more adventurous without hurting me. And he likes to do activities w me but doesnt want the responsability so best we D before he cheats again.

He wants me to stay with him in his house until after the baby is born so he can help out. But my friend says he s doing it for HIM so he can feel less bad (making your 5mo pregnant wife leave weighs on him and looks bad) and that with D come consequences like missing out on having access to your kids full time and he should feel that.

Now after a horrible weekend he's calmed down a bir. Says he foednt want us to split but he csnt do thus any more. Aagreed to come to counceling but to fill in how we can move forward, most likely in divorce.

Im so conflicted. It would physically and financially be easier for me to stay.
And Im hoping that he ll change his mind on us if he sees me independent and happy and active DB'ing. Im trying to do a 180.
But I dont want him to 'ease' in to separation while not feeling consequences. While maybe starting with another woman.
WHAT SHOULD I DO??? STAY OR GO??
Any other advice??