here's an idea: Kick him out.
Threatening to burn the house down is not ok.
Get a protection order, change the locks, and see if he straightens out.