IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v68y2022i2p846-865.html

Predicting Human Discretion to Adjust Algorithmic Prescription: A Large-Scale Field Experiment in Warehouse Operations

Author

Listed:
  • Jiankun Sun

    (Imperial College Business School, Imperial College London, London SW7 2AZ, United Kingdom)

  • Dennis J. Zhang

    (Olin Business School, Washington University in St. Louis, St. Louis, Missouri 63130)

  • Haoyuan Hu

    (Cainiao, Alibaba Group, Hangzhou 311101, China)

  • Jan A. Van Mieghem

    (Kellogg School of Management, Northwestern University, Evanston, Illinois 60208)

Abstract

Conventional optimization algorithms that prescribe order packing instructions (which items to pack in which sequence in which box) focus on box volume utilization yet tend to overlook human behavioral deviations. We observe that packing workers at the warehouses of the Alibaba Group deviate from algorithmic prescriptions for 5.8% of packages, and these deviations increase packing time and reduce operational efficiency. We posit two mechanisms and demonstrate that they result in two types of deviations: (1) information deviations stem from workers having more information and in turn better solutions than the algorithm; and (2) complexity deviations result from workers’ aversion, inability, or discretion to precisely implement algorithmic prescriptions. We propose a new “human-centric bin packing algorithm” that anticipates and incorporates human deviations to reduce deviations and improve performance. It predicts when workers are more likely to switch to larger boxes using machine learning techniques and then proactively adjusts the algorithmic prescriptions of those “targeted packages.” We conducted a large-scale randomized field experiment with the Alibaba Group. Orders were randomly assigned to either the new algorithm (treatment group) or Alibaba’s original algorithm (control group). Our field experiment results show that our new algorithm lowers the rate of switching to larger boxes from 29.5% to 23.8% for targeted packages and reduces the average packing time of targeted packages by 4.5%. This idea of incorporating human deviations to improve optimization algorithms could also be generalized to other processes in logistics and operations.

Suggested Citation

  • Jiankun Sun & Dennis J. Zhang & Haoyuan Hu & Jan A. Van Mieghem, 2022. "Predicting Human Discretion to Adjust Algorithmic Prescription: A Large-Scale Field Experiment in Warehouse Operations," Management Science, INFORMS, vol. 68(2), pages 846-865, February.
  • Handle: RePEc:inm:ormnsc:v:68:y:2022:i:2:p:846-865
    DOI: 10.1287/mnsc.2021.3990
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2021.3990
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2021.3990?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.
    2. Tom Fangyun Tan & Serguei Netessine, 2014. "When Does the Devil Make Work? An Empirical Study of the Impact of Workload on Worker Productivity," Management Science, INFORMS, vol. 60(6), pages 1574-1593, June.
    3. Karel H. van Donselaar & Vishal Gaur & Tom van Woensel & Rob A. C. M. Broekmeulen & Jan C. Fransoo, 2010. "Ordering Behavior in Retail Stores and Implications for Automated Replenishment," Management Science, INFORMS, vol. 56(5), pages 766-784, May.
    4. Nathan Charles Craig & Nicole DeHoratius & Ananth Raman, 2010. "The Impact of Supplier Inventory Service Level on Retailer Demand," Harvard Business School Working Papers 11-034, Harvard Business School, revised Jan 2016.
    5. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    6. Maurice E. Schweitzer & Gérard P. Cachon, 2000. "Decision Bias in the Newsvendor Problem with a Known Demand Distribution: Experimental Evidence," Management Science, INFORMS, vol. 46(3), pages 404-420, March.
    7. Sheng Liu & Long He & Zuo-Jun Max Shen, 2021. "On-Time Last-Mile Delivery: Order Assignment with Travel-Time Predictors," Management Science, INFORMS, vol. 67(7), pages 4095-4119, July.
    8. Chen, C. S. & Lee, S. M. & Shen, Q. S., 1995. "An analytical model for the container loading problem," European Journal of Operational Research, Elsevier, vol. 80(1), pages 68-76, January.
    9. Andrew M. Davis & Elena Katok & Natalia Santamaría, 2014. "Push, Pull, or Both? A Behavioral Study of How the Allocation of Inventory Risk Affects Channel Efficiency," Management Science, INFORMS, vol. 60(11), pages 2666-2683, November.
    10. Song-Hee Kim & Carri W. Chan & Marcelo Olivares & Gabriel Escobar, 2015. "ICU Admission Control: An Empirical Study of Capacity Allocation and Its Implication for Patient Outcomes," Management Science, INFORMS, vol. 61(1), pages 19-38, January.
    11. Gregory S. Taylor & Yupo Chan & Ghulam Rasool, 2017. "A three-dimensional bin-packing model: exact multicriteria solution and computational complexity," Annals of Operations Research, Springer, vol. 251(1), pages 397-427, April.
    12. Bradley R. Staats & Hengchen Dai & David Hofmann & Katherine L. Milkman, 2017. "Motivating Process Compliance Through Individual Electronic Monitoring: An Empirical Examination of Hand Hygiene in Healthcare," Management Science, INFORMS, vol. 63(5), pages 1563-1585, May.
    13. Silvano Martello & David Pisinger & Daniele Vigo, 2000. "The Three-Dimensional Bin Packing Problem," Operations Research, INFORMS, vol. 48(2), pages 256-267, April.
    14. Nathan Craig & Nicole DeHoratius & Ananth Raman, 2016. "The Impact of Supplier Inventory Service Level on Retailer Demand," Manufacturing & Service Operations Management, INFORMS, vol. 18(4), pages 461-474, October.
    15. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    16. John Boudreau & Wallace Hopp & John O. McClain & L. Joseph Thomas, 2003. "On the Interface Between Operations and Human Resources Management," Manufacturing & Service Operations Management, INFORMS, vol. 5(3), pages 179-202, September.
    17. Ruomeng Cui & Gad Allon & Achal Bassamboo & Jan A. Van Mieghem, 2015. "Information Sharing in Supply Chains: An Empirical and Theoretical Valuation," Management Science, INFORMS, vol. 61(11), pages 2803-2824, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    2. Diwas S. KC & Bradley R. Staats & Maryam Kouchaki & Francesca Gino, 2020. "Task Selection and Workload: A Focus on Completing Easy Tasks Hurts Performance," Management Science, INFORMS, vol. 66(10), pages 4397-4416, October.
    3. Tom F. Tan & Bradley R. Staats, 2020. "Behavioral Drivers of Routing Decisions: Evidence from Restaurant Table Assignment," Production and Operations Management, Production and Operations Management Society, vol. 29(4), pages 1050-1070, April.
    4. Bradley R. Staats & Diwas S. KC & Francesca Gino, 2018. "Maintaining Beliefs in the Face of Negative News: The Moderating Role of Experience," Management Science, INFORMS, vol. 64(2), pages 804-824, February.
    5. Mirko Kremer & Francis de Véricourt, 2022. "Mismanaging diagnostic accuracy under congestion," ESMT Research Working Papers ESMT-22-01, ESMT European School of Management and Technology.
    6. Clare Snyder & Samantha Keppler & Stephen Leider, 2026. "Algorithm Reliance: Fast and Slow," Management Science, INFORMS, vol. 72(1), pages 368-385, January.
    7. Christian Terwiesch & Marcelo Olivares & Bradley R. Staats & Vishal Gaur, 2020. "OM Forum—A Review of Empirical Operations Management over the Last Two Decades," Manufacturing & Service Operations Management, INFORMS, vol. 22(4), pages 656-668, July.
    8. Song-Hee Kim & Jordan Tong & Carol Peden, 2020. "Admission Control Biases in Hospital Unit Capacity Management: How Occupancy Information Hurdles and Decision Noise Impact Utilization," Management Science, INFORMS, vol. 66(11), pages 5151-5170, November.
    9. Mirko Kremer & Francis de Véricourt, 2023. "Mismanaging Diagnostic Accuracy Under Congestion," Operations Research, INFORMS, vol. 71(3), pages 895-916, May.
    10. Robert J. Niewoehner & Bradley R. Staats, 2022. "Focusing Provider Attention: An Empirical Examination of Incentives and Feedback in Flu Vaccinations," Management Science, INFORMS, vol. 68(5), pages 3680-3702, May.
    11. Ruomeng Cui & Meng Li & Shichen Zhang, 2022. "AI and Procurement," Manufacturing & Service Operations Management, INFORMS, vol. 24(2), pages 691-706, March.
    12. Felipe Caro & Anna Sáez de Tejada Cuenca, 2023. "Believing in Analytics: Managers’ Adherence to Price Recommendations from a DSS," Manufacturing & Service Operations Management, INFORMS, vol. 25(2), pages 524-542, March.
    13. Meng Li & Tao Li, 2022. "AI Automation and Retailer Regret in Supply Chains," Production and Operations Management, Production and Operations Management Society, vol. 31(1), pages 83-97, January.
    14. Julien Grand-Clément & Jean Pauphilet, 2026. "The Best Decisions Are Not the Best Advice: Making Adherence-Aware Recommendations," Management Science, INFORMS, vol. 72(1), pages 667-692, January.
    15. Anna‐Lena Sachs & Michael Becker‐Peth & Stefan Minner & Ulrich W. Thonemann, 2022. "Empirical newsvendor biases: Are target service levels achieved effectively and efficiently?," Production and Operations Management, Production and Operations Management Society, vol. 31(4), pages 1839-1855, April.
    16. Pol Boada-Collado & Victor Martínez-de-Albéniz, 2020. "Estimating and Optimizing the Impact of Inventory on Consumer Choices in a Fashion Retail Setting," Manufacturing & Service Operations Management, INFORMS, vol. 22(3), pages 582-597, May.
    17. Saravanan Kesavan & Tarun Kushwaha & Dayton Steele, 2026. "Profit Implications of Judgmental Adjustments to Forecast Inputs: Evidence from a Large-Scale Field Experiment," Management Science, INFORMS, vol. 72(1), pages 119-127, January.
    18. Lesley Meng & Robert J. Batt & Christian Terwiesch, 2021. "The Impact of Facility Layout on Service Worker Behavior: An Empirical Study of Nurses in the Emergency Department," Manufacturing & Service Operations Management, INFORMS, vol. 23(4), pages 819-834, July.
    19. Robert J. Niewoehner & KC Diwas & Bradley Staats, 2023. "Physician Discretion and Patient Pick-up: How Familiarity Encourages Multitasking in the Emergency Department," Operations Research, INFORMS, vol. 71(3), pages 958-978, May.
    20. Suparerk Lekwijit & Christian Terwiesch & David A. Asch & Kevin G. Volpp, 2024. "Evaluating the Efficacy of Connected Healthcare: An Empirical Examination of Patient Engagement Approaches and Their Impact on Readmission," Management Science, INFORMS, vol. 70(6), pages 3417-3446, June.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:68:y:2022:i:2:p:846-865. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.