Please go see an attny tomorrow. They will be able to advise you best. Your H certainly can open up any single account he likes. What he cannot do is take joint funds to fund his single account or remove you from accounts without your consent.

Protect yourself right now.