Those are great responses and I am going to use them.
H text me this morning and asked if S could have overnight Friday so I said sure and then to make sure I am driving my bus so to speak I said I would pick him up from H's house either at 10:00a.m. on Saturday or 2:30p.m. on Saturday and H could pick which time. It used to be if H had an overnight which rarely happened I would wait around all day or to whenever H text me to tell me he was bringing S home. Not convenient for me and I am done with that.
S doesn't want to spend overnight at dad's however last weekend he was going to but H ended up calling me at 5:00 (and he had just picked him up at 3:30) and said S was ready to come home so I told H I wouldn't be there for a couple of hours.
I like the "I need space away from you" because I do and S and I are going on vacation next Wednesday thru Sunday so that should help and then S starts school and I plan to have a schedule of H picking S up from school 3 days a week and that will give him 2 1/2 hours with S and then every other weekend a visitation or overnight. S may not want to do that and normally I would say that every child needs his father but H has such explosive anger at S that I understand why S doesn't want to spend a lot of time with H.