He is angry and it's impossible to speak with someone when they are that way.
As for him saying you were at his job... if he brings it up again, state very clearly and calmly that you were not and have nothing to do with his getting fired. If he doesn't believe you, that is his choice. Do not argue back though. It will get you nowhere.