Hopeful--your situation is tough. Much like everyone here, but I think you are doing great. You are doing things for you and for the kids....it's hard but yet wonderful at the same time.
I got hit on too and I had the EXACT same reaction! Not too shabby, even after children!
When you feel like things have dwindled, you need to come up with things to talk to him about. What are the stupid things you talk to your girlfriends with? What do you talk to him about? What exactly is "small talk" subject matter? I get my H to talk about things he loves....then after a while he'll ask me about what I love and my day, etc. It's taken a while to get that down, but it goes pretty well now.
And I don't think you should ever get to a point where you don't care whether you divorce or not. I say, keep fighting.
I went to Va Tech...where did you go?