I would stay. Pretend you are asleep if you have to when she gets home. Its 12am.

You're a man, you're watching your kids. It's not about whether or not she likes it. You're a man watching your kids and you're not going to be some whipped puppy that goes home at 12am because she feels uncomfortable.