Waterbur: I had the same situation although I never confirmed a PA with my H. (I believe it was more of an EA situation.) He would tell me he didn't have feelings for me, then initiate sex! It IS confusing. He said exactly what your H is saying: that he was physically attracted to me, and had love for me, but was not in love with me, followed by "don't think this changes anything..." Talk about mixed signals! What I kept in mind at that time was that as soon as there is anything that brings any kind of intimacy, the WAS usually then pulls away again and those statements (afterwards) are a result of that.
What's the answer? Well, I don't know if there is a cut and dry answer. I discussed it with FT and she said the same things PDT said above, basically. I think what you are wanting to know (because it is what I wanted to know) is how does it ultimately affect H and his mindset. Does it bring him closer to you or does it make you seem more like a doormat?!