So my advice above is probably not the best but it was my first thought. Perhaps you should say something more like:

I understand your frustration but I did not lose your pants on purpose. I do your laundry to be helpful. If you would like my help in finding your pants please just ask.