You did wonderful with that statement. His response was a head spin, trying to guilt you into giving him what he wants. Don't fall for it. Be prepared for him be having some big adult tantrums every time you keep your boundaries firm.
It's good you didn't respond. It's very hard when they react like that and it makes your blood boil!!!
Xh went banannas on me when I wouldn't lie for him to a low income apartment complex about how many days a week he had the girls. I almost did it but changed my mind the last minute and said no. Ya right Im going to tell those people he has the kids 50% of the time so he can have low income housing after he's stashed 1000's of dollars in the bank??