What's more important, being "rude", or sticking to a healthy bedtime for your daughter?
What's more important, being "rude" or enforcing healthy boundaries for your own emotional well-being?
Besides, it not being "rude" at all. You can add the appropriate social courtesies, and teach yourself to say things like "I'm so sorry, I don't mean to be rude, but I need to get D to bed now. We'll talk later this week -- bye!" (and then HANG UP).
or
"I'm so sorry, I just noticed the time. I don't mean to cut you off, but I'm now running late. We'll catch up tomorrow -- bye!" (and then HANG UP THE PHONE).