If that's the case, then it's not a boundary for you -- it's a "geeIwishYouWouldn't."
Take some time to consider what are TRULY your "dealbreakers" right now. Maybe the coming-and-going isn't, I don't know. Only you can decide that. Are you getting enough sleep to be able to perform at your job? Does her coming in so late disturb your sleep?