He sounds like a jerk. You deserve better. I think you should start "no contact," especially if he's tormenting you with details of his adulterous sex life. tell him that if he wants to get a hold of you about the divorce, have him talk to your attorney. Is your state a "no fault" state? If it is, there might be more of a struggle. If its not, then you can play the infidelity card and take him for everything!!
I think you should tell people, sooner rather than later. It'll help you move closer to acceptance and then you'll have support from people who love you. When I finally started telling some of my people at work, I was amazed on the amount of people who were personally or knew someone going through the same thing. These times really differentiate who your real friends are. Your H has failed you as a friend. Finding the real friends would be helpful.
I'm sorry to say that it won't be over fast. You can always hope for it but most Ds take at least 90 days and it'll take longer than that to recover from this. Take care of yourself. Do things that make you happy and avoid him all you can.
Stay positive! You're doing great!
When you are happy as an individual, you are in a better position to determine whether a partner enhances your happy life or weighs it down.