Yes, you do have someone you can call and get a break. Your H can take his kids for regular visitation. Start setting that up. Make him step up to the plate with a regular schedule.
I know you still have your older kids, but do they have regular visitation with THEIR father? If so, set up visitation at the same time so you get a real break.