Deb,
I think you nailed it with the "stress, worry, guilt" and I would add one more: depression.

I think he is still interested but, well, think about how YOU would feel if you had done something this horrible (and were still doing it, in a lot of ways) to your spouse. My goodness, the guilt alone would eat me alive.

I'm sure that he is thinking, Yeah Deb is hot..I want her so bad...but then HOW could I have done this to her?? She deserves so much better than me!
And next thing you know, Mr. Happy isn't playing anymore.

I wouldn't worry about it, and definitely don't use it as a guage of your attractiveness or how much he loves you. Just do as you have done and work your magic until he gets his head back in the game.

Good luck,
HP