I don't think you are borrowing trouble either. Rather, you are keeping your eyes open and your radar up. Instead of fretting about this however, or making assumptions, I think it is time to go back to basics. Remember your behavior and actions can affect his behavior and actions.
He is withdrawing and what you can do is think back to the era of the bomb about what didn't work. Perhaps you withdrew as a reponse to his withdrawl (I eventually did this when my H went into his funk)? What kinds of actions can you take to show H that you are indeed happy and in love with him and also show him that you care for him regardless of how he is acting right now.
Back to basics--make a goal list--look good, smell good--you know the drill better than anyone!
BTW my doctor just upped my synthroid to 100 nicro-grams. We'll see if it helps my current malaise.