You handled that response just perfectly! let him know that him blowing up their phone might have been a problem without making it seem like you were directly involved in that conversation. Confirming that you are not badmouthing him at home (which leaves him to have to deal with the fact that this is between him and his kids).
