I agree with Kat. You can't live your life worrying that if you ask for something or say something that he is going to walk out on you. I think you should have a serious honest talk with him and as Kat said, leave out the emotion as much as possible. He may welcome a frank open discussion with you, one that doesn't put him on the defensive, merely lets him know how you feel and the valid reasons why you are not asking him for help.
