Mojo,
He is crap-flinging. Not in a malicious way, but nonetheless he is flingin' all his crap your way and hoping that you will make it all better.

If it were me, I'd put it right back where it belongs--on him. With things like, "What has happened to get you thinking this way?" and open up the dialogue. Cause if the recent events have him thinking that there is a possibility that you might leave if there is no change, well, then GOOD! That is what you want. To have some leverage with which to work.
Reassuring him that you aren't going anywhere sortof puts him in the position of power again, don't you think? I think you can validate what he is saying but at the same time, let him know that your feelings haven't changed.

Something like: "I never intended to upset you or make you worry about whether I will be here when you return home. I simply can't live with things the way they are and was hoping that you would work with me on this."
That puts the onus back on HIM.

Just my thoughts but I'm in a bad frickin mood today and want to get up on my roof and scream "Down with LD men!!!"

Hugs,
Honey

P.S. I could never let a baby cry in its crib either.