He is probably still reeling from everything. He made some collossally bad choices and I'm sure there is a good deal of guilt. (that is, if the affair is over, like you said)

In addition to that, if you were the LD partner, he would have no reason to believe that your changes are real. He would naturally think you were doing this to "win him back" and that it would go back to the way it was as soon as he gets used to it.

I will let you in on an HD person's nightmare: Your spouse makes changes and learns to like sex with you. You cautiously take your guard down and begin to enjoy it. The floodgates open up and you find yourself in love with your partner as you haven't been for years. Then, it disappears as suddenly as it came and they no longer want you. The pain is intense--your heart is broken.

You are feeling a little of this now..the heartbreak that comes from rejection.

However, you wanna know my gut feeling? I don't think it's about the above scenario, though that might play into it.

I think he's still processing the affair and running the gamut of emotions that comes from that.

I hope he gets his stuff together soon.