I don't think anyone is going to tell you you haven't been married long enough. Don't worry about that.
I can imagine that the relationship between your H and your D could have been really hard on you, and your relationship to your H. Others here wil lhave a lot more perspective into that, having lived it.
I'm kind of thinking out loud here, do you know much about the circumstances of his previous marriages? Maybe there are clues there. Or, from you previous marriages, for that matter. I'm just looking for snippets of insight.
Right not it seems pretty clear that space is what he needs, and it strikes me that it is helping. I'm sure he knows that you are hurt, and love him, and miss him. Remember the crying and begging? He knows! By being kind, and listending, and validating when he talks to you, you are reinforcing that, as well.