I really think that you need to lay it all on the line with this. Like all the other ladies have said you are damned if you do and damned if you don't. He won't touch you because she says that you are not trustworthy. If you didn't say anything she would say that you are not open enough or that you are with holding or any of about 10,000 other reasons. If you want to get this stuff resolved you need to talk about it.
It sounds to me like your wife wants to be in complete control of you. You already know this. I really think this is all coming from a place that she is losing that control so now she is going to make excuses. Instead of looking into herself and see why she needs to be in total control.
So what do you have to lose by letting it all hang out?