"I don't think we have much chance"


Probably a reaction to hearing that you feel bullied. It might be true, but if he really heard it, it probably made him feel terrible. Like you have felt when he has expressed certain safety fears. So maybe it's temporary dejection from that.