IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v66y2020i6p2396-2416.html
   My bibliography  Save this article

How Scheduling Can Bias Quality Assessment: Evidence from Food-Safety Inspections

Author

Listed:
  • Maria R. Ibanez

    (Kellogg School of Management at Northwestern University, Evanston, Illinois 60208)

  • Michael W. Toffel

    (Harvard Business School, Boston, Massachusetts 02163)

Abstract

Accuracy and consistency are critical for inspections to be an effective, fair, and useful tool for assessing risks, quality, and suppliers—and for making decisions based on those assessments. We examine how inspector schedules could introduce bias that erodes inspection quality by altering inspector stringency. Our analysis of thousands of food-safety inspections reveals that inspectors are affected by the inspection outcomes at their prior-inspected establishment ( outcome effects ), citing more violations after they inspect establishments that exhibited worse compliance levels or trends. Moreover, consistent with negativity bias, the effect is stronger after observing compliance deterioration than improvement. Inspection results are also affected by when the inspection occurs within an inspector’s day ( daily schedule effects ): Inspectors cite fewer violations after spending more time conducting inspections throughout the day and when inspections risk prolonging their typical workday. Overall, our findings suggest that currently unreported violations would be cited if the outcome effects—which increase scrutiny—were triggered more often and if the daily schedule effects—which erode scrutiny—were reduced. For example, our estimates indicate that if outcome effects were doubled and daily schedule effects were fully mitigated, 11% more violations would be detected, enabling remedial actions that could substantially reduce foodborne illnesses and hospitalizations. Understanding and addressing these inspection biases can help managers and policymakers improve not only food safety but also process quality, environmental practices, occupational safety, and working conditions.

Suggested Citation

  • Maria R. Ibanez & Michael W. Toffel, 2020. "How Scheduling Can Bias Quality Assessment: Evidence from Food-Safety Inspections," Management Science, INFORMS, vol. 66(6), pages 2396-2416, June.
  • Handle: RePEc:inm:ormnsc:v:66:y:2020:i:6:p:2396-2416
    DOI: 10.1287/mnsc.2019.3318
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/mnsc.2019.3318
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2019.3318?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Lehman, David W. & Kovacs, Balazs & Carroll, Glenn R., 2014. "Conflicting Social Codes and Organizations: Hygiene and Authenticity in Consumer Evaluations of Restaurants," Research Papers 3161, Stanford University, Graduate School of Business.
    2. Edward L. Glaeser & Andrew Hillis & Scott Duke Kominers & Michael Luca, 2016. "Crowdsourcing City Government: Using Tournaments to Improve Inspection Accuracy," American Economic Review, American Economic Association, vol. 106(5), pages 114-118, May.
    3. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    4. Jodi L. Short & Michael W. Toffel & Andrea R. Hugill, 2016. "Code Contingencies: Designing Monitoring Regimes to Promote Improvement in Supply Chain Working Conditions," Harvard Business School Working Papers 17-001, Harvard Business School, revised Mar 2019.
    5. Shimshack, Jay P. & Ward, Michael B., 2005. "Regulator reputation, enforcement, and environmental compliance," Journal of Environmental Economics and Management, Elsevier, vol. 50(3), pages 519-540, November.
    6. Gopesh Anand & John Gray & Enno Siemsen, 2012. "Decay, Shock, and Renewal: Operational Routines and Process Entropy in the Pharmaceutical Industry," Organization Science, INFORMS, vol. 23(6), pages 1700-1716, December.
    7. Stafford, Sarah L, 2003. "Assessing the Effectiveness of State Regulation and Enforcement of Hazardous Waste," Journal of Regulatory Economics, Springer, vol. 23(1), pages 27-41, January.
    8. David I. Levine & Michael W. Toffel, 2010. "Quality Management and Job Quality: How the ISO 9001 Standard for Quality Management Systems Affects Employees and Employers," Management Science, INFORMS, vol. 56(6), pages 978-996, June.
    9. Esther Duflo & Michael Greenstone & Nicholas Ryan, 2013. "Truth-telling by Third-party Auditors and the Response of Polluting Firms: Experimental Evidence from India," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1499-1545.
    10. Lamar Pierce & Michael W. Toffel, 2013. "The Role of Organizational Scope and Governance in Strengthening Private Monitoring," Organization Science, INFORMS, vol. 24(5), pages 1558-1584, October.
    11. Sang-Hyun Kim, 2015. "Time to Come Clean? Disclosure and Inspection Policies for Green Production," Operations Research, INFORMS, vol. 63(1), pages 1-20, February.
    12. Joshua Ronen, 2010. "Corporate Audits and How to Fix Them," Journal of Economic Perspectives, American Economic Association, vol. 24(2), pages 189-210, Spring.
    13. Charles J. Corbett, 2006. "Global Diffusion of ISO 9000 Certification Through Supply Chains," Manufacturing & Service Operations Management, INFORMS, vol. 8(4), pages 330-350, January.
    14. A. Gürhan Kök & Kevin H. Shang, 2007. "Inspection and Replenishment Policies for Systems with Inventory Record Inaccuracy," Manufacturing & Service Operations Management, INFORMS, vol. 9(2), pages 185-205, February.
    15. George Ball & Enno Siemsen & Rachna Shah, 2017. "Do Plant Inspections Predict Future Quality? The Role of Investigator Experience," Manufacturing & Service Operations Management, INFORMS, vol. 19(4), pages 534-550, October.
    16. Eric Helland, 1998. "The Enforcement Of Pollution Control Laws: Inspections, Violations, And Self-Reporting," The Review of Economics and Statistics, MIT Press, vol. 80(1), pages 141-153, February.
    17. Pierre Azoulay & Joshua S. Graff Zivin & Jialan Wang, 2010. "Superstar Extinction," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 125(2), pages 549-589.
    18. Jillian A. Berry Jaeker & Anita L. Tucker, 2017. "Past the Point of Speeding Up: The Negative Effects of Workload Saturation on Efficiency and Patient Severity," Management Science, INFORMS, vol. 63(4), pages 1042-1062, April.
    19. Donald P. Ballou & Harold L. Pazer, 1982. "The Impact of Inspector Fallibility on the Inspection Policy in Serial Production Systems," Management Science, INFORMS, vol. 28(4), pages 387-399, April.
    20. Hau L. Lee & Meir J. Rosenblatt, 1987. "Simultaneous Determination of Production Cycle and Inspection Schedules in a Production System," Management Science, INFORMS, vol. 33(9), pages 1125-1136, September.
    21. A. Colin Cameron & Pravin K. Trivedi, 2010. "Microeconometrics Using Stata, Revised Edition," Stata Press books, StataCorp LP, number musr, March.
    22. Langpap, Christian & Shimshack, Jay P., 2010. "Private citizen suits and public enforcement: Substitutes or complements?," Journal of Environmental Economics and Management, Elsevier, vol. 59(3), pages 235-249, May.
    23. Ginger Zhe Jin & Phillip Leslie, 2003. "The Effect of Information on Product Quality: Evidence from Restaurant Hygiene Grade Cards," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(2), pages 409-451.
    24. Feinstein, Jonathan S, 1989. "The Safety Regulation of U.S. Nuclear Power Plants: Violations, Inspections, and Abnormal Occurrences," Journal of Political Economy, University of Chicago Press, vol. 97(1), pages 115-154, February.
    25. Chen, Daniel L. & Moskowitz, Tobias J. & Shue, Kelly, 2016. "Decision-Making Under the Gambler’s Fallacy: Evidence From Asylum Courts, Loan Officers, and Baseball Umpires," IAST Working Papers 16-43, Institute for Advanced Study in Toulouse (IAST).
    26. Michelle C. Pautz, 2010. "Front‐line Regulators and their Approach to Environmental Regulation in Southwest Ohio," Review of Policy Research, Policy Studies Organization, vol. 27(6), pages 761-780, November.
    27. Kishore Gawande & Alok K. Bohara, 2005. "Agency Problems in Law Enforcement: Theory and Application to the U.S. Coast Guard," Management Science, INFORMS, vol. 51(11), pages 1593-1609, November.
    28. David C. Chan, 2018. "The Efficiency of Slacking off: Evidence From the Emergency Department," Econometrica, Econometric Society, vol. 86(3), pages 997-1030, May.
    29. Tanguy Brachet & Guy David & Andrea M. Drechsler, 2012. "The Effect of Shift Structure on Performance," American Economic Journal: Applied Economics, American Economic Association, vol. 4(2), pages 219-246, April.
    30. Michael A. Lapré & Amit Shankar Mukherjee & Luk N. Van Wassenhove, 2000. "Behind the Learning Curve: Linking Learning Activities to Waste Reduction," Management Science, INFORMS, vol. 46(5), pages 597-611, May.
    31. Ginger Zhe Jin & Phillip Leslie, 2009. "Reputational Incentives for Restaurant Hygiene," American Economic Journal: Microeconomics, American Economic Association, vol. 1(1), pages 237-267, February.
    32. Samuelson, William & Zeckhauser, Richard, 1988. "Status Quo Bias in Decision Making," Journal of Risk and Uncertainty, Springer, vol. 1(1), pages 7-59, March.
    33. Victor Manuel Bennett & Lamar Pierce & Jason A. Snyder & Michael W. Toffel, 2013. "Customer-Driven Misconduct: How Competition Corrupts Business Practices," Management Science, INFORMS, vol. 59(8), pages 1725-1742, August.
    34. David W. Lehman & Balázs Kovács & Glenn R. Carroll, 2014. "Conflicting Social Codes and Organizations: Hygiene and Authenticity in Consumer Evaluations of Restaurants," Management Science, INFORMS, vol. 60(10), pages 2602-2617, October.
    35. Bradley R. Staats & Francesca Gino, 2012. "Specialization and Variety in Repetitive Tasks: Evidence from a Japanese Bank," Management Science, INFORMS, vol. 58(6), pages 1141-1159, June.
    36. Daniel Kahneman, 2003. "Maps of Bounded Rationality: Psychology for Behavioral Economics," American Economic Review, American Economic Association, vol. 93(5), pages 1449-1475, December.
    37. Jeffrey T. Macher & John W. Mayo & Jack A. Nickerson, 2011. "Regulator Heterogeneity and Endogenous Efforts to Close the Information Asymmetry Gap," Journal of Law and Economics, University of Chicago Press, vol. 54(1), pages 25-54.
    38. Bradley R. Staats & Hengchen Dai & David Hofmann & Katherine L. Milkman, 2017. "Motivating Process Compliance Through Individual Electronic Monitoring: An Empirical Examination of Hand Hygiene in Healthcare," Management Science, INFORMS, vol. 63(5), pages 1563-1585, May.
    39. Travis Minor & Angela Lasher & Karl Klontz & Bradley Brown & Clark Nardinelli & David Zorn, 2015. "The Per Case and Total Annual Costs of Foodborne Illness in the United States," Risk Analysis, John Wiley & Sons, vol. 35(6), pages 1125-1139, June.
    40. Rogelio Oliva & John D. Sterman, 2001. "Cutting Corners and Working Overtime: Quality Erosion in the Service Industry," Management Science, INFORMS, vol. 47(7), pages 894-914, July.
    41. Jay P. Shimshack, 2014. "The Economics of Environmental Monitoring and Enforcement," Annual Review of Resource Economics, Annual Reviews, vol. 6(1), pages 339-360, October.
    42. Jodi L. Short & Michael W. Toffel & Andrea R. Hugill, 2016. "Monitoring global supply chains," Strategic Management Journal, Wiley Blackwell, vol. 37(9), pages 1878-1897, September.
    43. Diwas Singh KC & Christian Terwiesch, 2012. "An Econometric Analysis of Patient Flows in the Cardiac Intensive Care Unit," Manufacturing & Service Operations Management, INFORMS, vol. 14(1), pages 50-65, January.
    44. Daniel L. Chen & Tobias J. Moskowitz & Kelly Shue, 2016. "Decision Making Under the Gambler’s Fallacy: Evidence from Asylum Judges, Loan Officers, and Baseball Umpires," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(3), pages 1181-1242.
    45. Sameer Hasija & Edieal Pinker & Robert A. Shumsky, 2010. "OM Practice--Work Expands to Fill the Time Available: Capacity Estimation and Staffing Under Parkinson's Law," Manufacturing & Service Operations Management, INFORMS, vol. 12(1), pages 1-18, September.
    46. Sean M. Handley & John V. Gray, 2013. "Inter-organizational Quality Management: The Use of Contractual Incentives and Monitoring Mechanisms with Outsourced Manufacturing," Production and Operations Management, Production and Operations Management Society, vol. 22(6), pages 1540-1556, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Büşra Ergün‐Şahin & Evrim Didem Güneş & Ayşe Kocabıyıkoğlu & Ahmet Keskin, 2022. "How does workload affect test ordering behavior of physicians? An empirical investigation," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2664-2680, June.
    2. Kovács, Balázs & Lehman, David W. & Carroll, Glenn R., 2020. "Grade inflation in restaurant hygiene inspections: Repeated interactions between inspectors and restaurateurs," Food Policy, Elsevier, vol. 97(C).
    3. Makofske, Matthew Philip, 2021. "Spoiled food and spoiled surprises: Inspection anticipation and regulatory compliance," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 348-365.
    4. Saravanan Kesavan & Susan J. Lambert & Joan C. Williams & Pradeep K. Pendem, 2022. "Doing Well by Doing Good: Improving Retail Store Performance with Responsible Scheduling Practices at the Gap, Inc," Management Science, INFORMS, vol. 68(11), pages 7818-7836, November.
    5. Moeen Naseer Butt, 2023. "Mitigating the negative effect of intrabrand clustering: the role of interbrand clustering and firm size," Journal of Brand Management, Palgrave Macmillan, vol. 30(1), pages 34-48, January.
    6. Hummy Song & Elena Andreyeva & Guy David, 2022. "Time Is the Wisest Counselor of All: The Value of Provider–Patient Engagement Length in Home Healthcare," Management Science, INFORMS, vol. 68(1), pages 420-441, January.
    7. Robert J. Niewoehner & Bradley R. Staats, 2022. "Focusing Provider Attention: An Empirical Examination of Incentives and Feedback in Flu Vaccinations," Management Science, INFORMS, vol. 68(5), pages 3680-3702, May.
    8. Aharon Mohliver & Amandine Ody-Brasier, 2023. "Religious Affiliation and Wrongdoing: Evidence from U.S. Nursing Homes," Management Science, INFORMS, vol. 69(1), pages 533-554, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alm, James & Shimshack, Jay, 2014. "Environmental Enforcement and Compliance: Lessons from Pollution, Safety, and Tax Settings," Foundations and Trends(R) in Microeconomics, now publishers, vol. 10(4), pages 209-274, December.
    2. Jodi L. Short & Michael W. Toffel & Andrea R. Hugill, 2016. "Monitoring global supply chains," Strategic Management Journal, Wiley Blackwell, vol. 37(9), pages 1878-1897, September.
    3. George Ball & Enno Siemsen & Rachna Shah, 2017. "Do Plant Inspections Predict Future Quality? The Role of Investigator Experience," Manufacturing & Service Operations Management, INFORMS, vol. 19(4), pages 534-550, October.
    4. Delasay, Mohammad & Ingolfsson, Armann & Kolfal, Bora & Schultz, Kenneth, 2019. "Load effect on service times," European Journal of Operational Research, Elsevier, vol. 279(3), pages 673-686.
    5. Vidya Mani & Suresh Muthulingam, 2019. "Does Learning from Inspections Affect Environmental Performance? Evidence from Unconventional Well Development in Pennsylvania," Service Science, INFORMS, vol. 21(1), pages 177-197, January.
    6. Beatty, Timothy & Shimshack, Jay P., 2018. "Monitoring and Enforcement in a Food Safety Context," 2018 Annual Meeting, August 5-7, Washington, D.C. 273913, Agricultural and Applied Economics Association.
    7. Mirko Kremer & Francis de Véricourt, 2022. "Mismanaging diagnostic accuracy under congestion," ESMT Research Working Papers ESMT-22-01, ESMT European School of Management and Technology.
    8. Jodi L. Short & Michael W. Toffel & Andrea Read Hugill, 2013. "Monitoring Global Supply Chains," Harvard Business School Working Papers 14-032, Harvard Business School, revised Jun 2015.
    9. Suvrat Dhanorkar & Enno Siemsen, 2021. "How Nudges Lead to Improved Energy Efficiency in Manufacturing: Evidence from Archival Data and a Field Study," Production and Operations Management, Production and Operations Management Society, vol. 30(10), pages 3735-3757, October.
    10. Tom Fangyun Tan & Serguei Netessine, 2014. "When Does the Devil Make Work? An Empirical Study of the Impact of Workload on Worker Productivity," Management Science, INFORMS, vol. 60(6), pages 1574-1593, June.
    11. Kovács, Balázs & Lehman, David W. & Carroll, Glenn R., 2020. "Grade inflation in restaurant hygiene inspections: Repeated interactions between inspectors and restaurateurs," Food Policy, Elsevier, vol. 97(C).
    12. Lamar Pierce & Michael W. Toffel, 2013. "The Role of Organizational Scope and Governance in Strengthening Private Monitoring," Organization Science, INFORMS, vol. 24(5), pages 1558-1584, October.
    13. Suvrat S. Dhanorkar & Enno Siemsen & Kevin W. Linderman, 2018. "Promoting Change from the Outside: Directing Managerial Attention in the Implementation of Environmental Improvements," Management Science, INFORMS, vol. 64(6), pages 2535-2556, June.
    14. Büşra Ergün‐Şahin & Evrim Didem Güneş & Ayşe Kocabıyıkoğlu & Ahmet Keskin, 2022. "How does workload affect test ordering behavior of physicians? An empirical investigation," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2664-2680, June.
    15. Michael Freeman & Nicos Savva & Stefan Scholtes, 2017. "Gatekeepers at Work: An Empirical Analysis of a Maternity Unit," Management Science, INFORMS, vol. 63(10), pages 3147-3167, October.
    16. Robert J. Batt & Christian Terwiesch, 2017. "Early Task Initiation and Other Load-Adaptive Mechanisms in the Emergency Department," Management Science, INFORMS, vol. 63(11), pages 3531-3551, November.
    17. Shimshack, Jay P. & Ward, Michael B., 2022. "Costly sanctions and the treatment of frequent violators in regulatory settings," Journal of Environmental Economics and Management, Elsevier, vol. 116(C).
    18. Wayne B. Gray & Jay P. Shimshack, 2011. "The Effectiveness of Environmental Monitoring and Enforcement: A Review of the Empirical Evidence," Review of Environmental Economics and Policy, Association of Environmental and Resource Economists, vol. 5(1), pages 3-24, Winter.
    19. Diwas S. KC & Bradley R. Staats & Maryam Kouchaki & Francesca Gino, 2020. "Task Selection and Workload: A Focus on Completing Easy Tasks Hurts Performance," Management Science, INFORMS, vol. 66(10), pages 4397-4416, October.
    20. Xian Liu & Barrett Kirwan & Andrea Martens, 2018. "Regulatory compliance, information disclosure and peer effects: evidence from the Mexican gasoline market," Journal of Regulatory Economics, Springer, vol. 54(1), pages 53-80, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:66:y:2020:i:6:p:2396-2416. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.