I can relate to what you are going through. My H gave me an information that I think it might be helpful. He feels that I am like a traffic light, going from red to green in a moment and he feels it's confusing.
So I am trying to be more consistent thinkings about that image.
Look at the bright side. By wanting some space and trusting him to go out of town is an achievement. I am in a point I couldn't cope with some schedule for my H to be home. So look at it as an advance and a sign the fear is fading.
