HELP! not sure what to do now.

[kissak]

Ok, this is my sitch....Husband not happy, left after 14 years of marriage, 2 kids, said nothing will change his mind....He has a brief affair, 2 months later, he's not 100% sure of things, breaks it off with OW, which broke his heart, but wanted to be sure he did everything he could to save his marriage. 2 months later he has pretty much moved back in, says he is still unsure. Says he has no feelings for me, doesn't think we can get them back, he said we have both changed, he agrees to see MC, starts staying at his apt again. MC says we need to get to know one another, so we try for a week or so, go off for the weekend, no kids, and now here we are.....All weekend we had a good time, just a little uncomfortable. He was not affectionate at all, but did want "Just sex", told me that, didn't want me to get wrong impression. Won't kiss me, just a hug if I ask. I feel like it is hopeless. It is like he really don't want this and is only doing it to make me tell him Im done. I can't do that, even though I am tired of all of this, giving affection when you don't get any back is tiring and hurtful. Im sure he is in MLC, but what should I expect now. Is he finally going to say he has had enough? Then what do I do. Let him go or keep holding on to him until he gets through this crisis. How do I go on but still let him know that i will always be there? Im sure he will go back to OW after this. He said things seemed so natural for them. Whatever....that will wear off. Maybe, they were just really good friends before, you can't go back to just friendship after a relationship, can you?
What should I do, go ahead and tell him that I'm done, and that I can't put myself through this pain anymore? I don't want him to be able to lay blame on me later on for not giving it a chance, even though i feel his mind is made up and he is affraid to tell me that. Advice????I would appreciate any.....I know it sounds like I am rambling, just feel like i am at a dead end.