Sex starved wife who finally found out why

[DFE]

I know OW would explain it all. It makes sense to me but it is out of character for him as is all of this. We have tried counselling but honestly I dont think it works. She has us on a separation plan which I feel is bogus. She also suggested we see other people. I dont think that is for me. The last time we left MC we were both so upset we didnt talk for days. H then sent me an email telling me how hurt he was by our session and that he would always be there for me. I went by the house today to pick up some stuff and he asked me out to lunch. Against my better judgement I said yes. I tried to DB and keep the conversation light but everytime I see him I get so emotional. We both ended up sobbing at the end. He got very upset and told me that he never meant for this to happen and he never meant to hurt me but he is doing what is best for the both of us. He doesnt feel about me the way a H should feel about a W. He said if we tried to put this back together we will both be miserable and eventually it will make one of us have an affair. I see what he is saying but why do we have to be miserable. I guess I dont understand because I dont share his feeling. I am still attracted to him and all I wanted to do was hold him and tell him it would be ok. If he cries like that doesnt it mean he still has feelings for me????? Am I reading too much into it???