I agree with you Jo. I wouldn't be mean to him, just barely polite. He told you about 2nd OW to get under your skin. Don't react to it....ever!!! Stay calm, polite, but brief with him. He needs to learn that it's not "all about him". Also, he needs to understand that if he wants to see DD4, he's going to have to give in to you regarding your visits with the other girls. It's time for you to take a very firm stand with him and do not relent. If you stay the course, hopefully, in time, he'll be fairer in regards to your time with "all" your DDs.
BTW, have I mentioned lately that Andy is a jerk????
You're doing good, Jo. Just don't let him see you crying, angry or depressed.