You have done nothing wrong. This is just reality and he needs to deal with it like an adult. You cannot be afraid of his reaction. This is a problem you have to tackle together but at the same time he needs to really look at it and see what needs to be done, as far as your living situation.
He might lash out like a 2 year old when he realizes he is not getting his way anymore but let him deal with it, it is his problem. Focus on yourself and do not get too worked up about what his reaction might be.
