Are you legitimately afraid if his anger ( as in concerned he might cause you harm)? Or is it just uncomfortable to be around him if he has those feelings?
I would stay away from debating with him what he did or didn’t say or what he did or didn’t mean. They don’t remember half of what they said anyway.
If you have a clear timeline in which you would like him to move out, then send that to him in writing. That can help keep emotions in check. If you’re ambivalent because if the help he’s giving, then don’t bring it up until you’re ready to give him a timeline.