Make sure that they know ahead of time that is your plan. Send an e-mail to SIL thanking her for the invite, but letting her know you will be stopping by with baby, then leaving before dinner. That way you don't have to explain yourself when you get there and she won't be short any desserts!
"You can't stop the waves, but you can learn to surf." Jon Kabat-Zinn