First and foremost protect yourself and do whatever it takes to make sure you're secure financially. Your H is no help to you now and won't be for some time.
If/when you reconnect it won't have anything to do with the business anyway. If letting it go is what's best for you then do it. All he's going to do right now is run up debt. Separate at least that part of it for yourself so you're not responsible and paying anymore for his affair than you have already.
Your H can then feel what it really is not to have Mila in his life.
If you two eventually decide to get back together it will be with a brand new marriage that has to be built from the ground up anyway.
You have had businesses before with your H and you know that to be successful you both have to be 100% invested. Your H isn't capable of doing that right now.
Don't ever feel guilty for looking out for yourself. You're the only one who can.