I'd say it would depend on the shove. If he is just poking you trying to make it uncomfortable enough that you leave, don't call 911. If he is shoving you hard enough to physically make you fall out of the bed, you should consider it. It is possible to sustain major injury falling out of the bed. Now, as a fit young woman, you probably won't be injured.
However, if he is shoving you hard enough to push you out of the bed, I think the best thing to do would be to leave and then contact the police department the next day and get advice on how you should respond. In other words, keep it low key, without the drama of flashing lights in your house late at night, but be safe. If you ever think he will get dangerously violent, call 911 immediately and try leave the house (with your child).
Chromo
"Recollect me darlin, raise me to your lips, two undernourished egos, four rotating hips"