Okay, and this is where we lose everyone not in I.T.
I also do billing, remember? Billing affects the bottom line that all the head honchos look at. If I get data that is that unmanageable, there comes a point where the billing output does not warrant the amount of time (cost) I'm spending trying to parse it out.
I can do what I can, but there often isn't the time or budget to train me to do something differently. I can ask the switch people to resend the file because possibly the data is corrupt. I can ask them to reformat it into something I can more easily translate. Hopefully, my asking wouldn't put them immediately on the defensive because they feel criticized (ironically, they never do) and dig their heels in behind their defensiveness. But life goes on and the next day I have another 60m records to process, and it's not like this is the only problem I ever encounter. Eventually, I would be doing nothing but spinning my wheels on seemingly unresolvable issues and nothing is getting billed. It wouldn't be long before I either resigned or got fired.