Get a babysitter for the week, or at least part of the days. D4 is just too young to entertain herself for so long.
As for the new neighbors - I hope they are renters. We once had drug dealers move in across the street from us. (In a very nice neighborhood in a wealthy town). Bunches of cars would show up when the bars closed at night, all kinds of sketchy people coming and going. The neighbors got together and complained to the landlord, and finally through a city program were able to get him to evict them. Shortly before they moved, FBI agents came to my home and asked me to call them if I saw them starting to move - they were tracking them, trying to catch the bigger fish.
We sure slept better once they were gone. I hope your neighbors were just having a one-off visit from a drunk uncle, but if it continues, start talking to the other neighbors.