Cry it out sister. Don't fight it, just let it happen, then let it pass. You deserve better treatment, and freedom from his spew/bad moods/OW junk.
I'm in Week 3 of H being gone. Its hard, just tackle it every day, and try your best not to make your face time with him awkward. When he comes around, make a big deal "Dad's here!", then give him space to be with the kids.