You pegged it. There is nothing but confusion to be gained from you letting up on the OW rule. It will do nothing for the kids. Your H needs to give up his special (barf) OW time for sake of his children. YOU may not feel guilty for that.
Displaced, I can totally see that. He knows its his fault too, so being sad is hard for him because he can't blame it on anyone but himself.
