Of course you can go out whenever you like, and your 18 year old can babysit. The court did not say that YOU needed supervised visitation! That is completely on him.

You are still so afraid of pissing him off, stirring the pot - tell me, is he afraid you'll get mad so he doesn't meet with other woman, drink and do drugs? Let him get mad! He is a grown-up and can have any reaction that he wants - it has nothing to do with you.
If you don't want to remind him outright that he has to be supervised, just ignore his rants. Or, you can tell him he can spend time with the baby as long as he pays for a professional supervisor when you are out (I think they are available, but he would have to pay them directly for their time).

I'm sorry that this is so hard for you....it is always much easier for someone outside our own sitches to really see what is going on.