Im sorry..That does sound difficult But If I can make one suggestion. ....try not to focus on it or intensify the fear behind it As you said, you are in a good location and well protected..
You can and need to be alert and careful but don't let it control you ...that's what he wants
If it continues, you can speak with your L and come up with a solution
keep your energy light and send him good or if your inclined to pray find a prayer that seems fit and send it energetically
I have one I use and it really helps in any situation where there is a bit of conflict or unease
married 14 years H 42 bomb 2/07 IDLYA D final 3 /09 M ow D ow