I feel that him going out only he and God knows where interacting with people is putting our kids in jeopardy of contracting coronavirus. Maybe I am alone with these concerns.
It's valid to be concerned about an extra exposure, but to put things in perspective, your risk profile is about the same as if he divorced you and remarried her, which is legal and common in the US. It's frustrating to raise your concerns and have them fall on deaf ears, but consider limiting risks that are under your control--e.g., visits to shops, good handwashing, and protective gear. Maybe he'd be more willing to comply with those methods of limiting exposure since they don't require him to discard someone important to him.
Of course, if you can get him to leave, that's even better.