I think it's normal to go back and forth on how you want to handle things. At least I hope it is. Some days I feel really good, like I can go on for a long time, and others I just can't see lasting another day. I've been trying to identify what gives me the good, positive feelings and do more of that. I hate feeling negative about anything.
I also hate the thought of being the backup plan or the safety net. That really gets me worked up when I think about it.
And I couldn't agree with you more about no sex or affection of any kind. I just don't see how you can start to piece a marriage back together without those things. Maybe it just takes time for them to be ready.