Is it unfair to take the sex back?

[74Kim]

My H just recently had an affair. And ended it w/ the OW. I w/held sex for only a week because I wasnt ready. I continue to have sex, but I feel awful most of the time. Only a couple times when I felt we really made Love, I felt good about it. I want to stop completly but I feel it wouldnt be fair to him. I dont fear he will turn to her or anyone else, I just want to go about this the right way. Does sex get any easier? Or will it always be a ? in my mind?