I don't think of it as being a doormat, but that (in my mind) has alot to do with what is going on in your head. If you let him do it out of fear...that's doormat world to me. Like WCW said though, it's all subject to interpretation. You know him and you, we don't.
Trying to save your marriage is good, what about you though? I know you have limited time, but it is soooo important. We all deal with the different constraints of our lives. My time is seriously limited too, but I make a point to do things for me. Granted my D's are older and more self sufficient, but they are with me 24/7.
I know that sometimes talking is the only thing that really helps sometimes. Good for you that you are limiting what you say to those that know him. That's one of the great things about this bb, you can say anything and get feedback on it. There is also ways to find some of us off here.