IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v72y2026i1p368-385.html

Algorithm Reliance: Fast and Slow

Author

Listed:
  • Clare Snyder

    (Ross School of Business, University of Michigan, Ann Arbor, Michigan 48109)

  • Samantha Keppler

    (Ross School of Business, University of Michigan, Ann Arbor, Michigan 48109)

  • Stephen Leider

    (Ross School of Business, University of Michigan, Ann Arbor, Michigan 48109)

Abstract

In algorithm-augmented service contexts where workers have decision authority, they face two decisions about the algorithm: whether to follow its advice and how quickly to do so. The pressure to work quickly increases with the speed of arriving customers. In this paper, we ask the following. How do workers use algorithms to manage system loads? With a laboratory experiment, we find that superior algorithm quality and high system loads increase participants’ willingness to use their algorithm’s advice. Consequently, participants with the superior algorithm make higher-quality recommendations than those with no algorithm (participants with the inferior algorithm make slightly lower-quality recommendations than those without). However, participants do not necessarily speed up by using algorithms’ advice; their throughput times only decrease compared with the no-algorithm baseline when the system load is high and algorithm quality is superior, although participants would benefit from working faster in all treatments. This happens in part because participants in the high-load, superior-algorithm treatment serve customers more quickly than participants in the other treatments, conditional on using the algorithm. Participants in the high-load, superior-algorithm treatment work especially quickly in later periods as they increasingly default to their algorithm’s advice. Our findings show that algorithms can have benefits for both decision quality and speed. Quality benefits come from workers’ decision to use their algorithms’ advice, whereas speed benefits depend on workers’ algorithm use and the time they spend deliberating about their algorithm use . Ultimately, algorithm quality and system load are mutually reinforcing factors that influence both service quality and especially speed.

Suggested Citation

  • Clare Snyder & Samantha Keppler & Stephen Leider, 2026. "Algorithm Reliance: Fast and Slow," Management Science, INFORMS, vol. 72(1), pages 368-385, January.
  • Handle: RePEc:inm:ormnsc:v:72:y:2026:i:1:p:368-385
    DOI: 10.1287/mnsc.2023.01989
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.2023.01989
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.2023.01989?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kohei Kawaguchi, 2021. "When Will Workers Follow an Algorithm? A Field Experiment with a Retail Business," Management Science, INFORMS, vol. 67(3), pages 1670-1695, March.
    2. Tom Fangyun Tan & Serguei Netessine, 2014. "When Does the Devil Make Work? An Empirical Study of the Impact of Workload on Worker Productivity," Management Science, INFORMS, vol. 60(6), pages 1574-1593, June.
    3. Robert J. Batt & Christian Terwiesch, 2017. "Early Task Initiation and Other Load-Adaptive Mechanisms in the Emergency Department," Management Science, INFORMS, vol. 63(11), pages 3531-3551, November.
    4. Karel H. van Donselaar & Vishal Gaur & Tom van Woensel & Rob A. C. M. Broekmeulen & Jan C. Fransoo, 2010. "Ordering Behavior in Retail Stores and Implications for Automated Replenishment," Management Science, INFORMS, vol. 56(5), pages 766-784, May.
    5. Duch, Matthias L. & Grossmann, Max R.P. & Lauer, Thomas, 2020. "z-Tree unleashed: A novel client-integrating architecture for conducting z-Tree experiments over the Internet," Journal of Behavioral and Experimental Finance, Elsevier, vol. 28(C).
    6. Wallace J. Hopp & Seyed M. R. Iravani & Gigi Y. Yuen, 2007. "Operations Systems with Discretionary Task Completion," Management Science, INFORMS, vol. 53(1), pages 61-77, January.
    7. Ben Greiner, 2004. "The Online Recruitment System ORSEE 2.0 - A Guide for the Organization of Experiments in Economics," Working Paper Series in Economics 10, University of Cologne, Department of Economics.
    8. Ben Greiner, 2004. "The Online Recruitment System ORSEE - A Guide for the Organization of Experiments in Economics," Papers on Strategic Interaction 2003-10, Max Planck Institute of Economics, Strategic Interaction Group.
    9. Kenneth L. Schultz & David C. Juran & John W. Boudreau & John O. McClain & L. Joseph Thomas, 1998. "Modeling and Worker Motivation in JIT Production Systems," Management Science, INFORMS, vol. 44(12-Part-1), pages 1595-1607, December.
    10. Gary P. Pisano & Richard M.J. Bohmer & Amy C. Edmondson, 2001. "Organizational Differences in Rates of Learning: Evidence from the Adoption of Minimally Invasive Cardiac Surgery," Management Science, INFORMS, vol. 47(6), pages 752-768, June.
    11. Delasay, Mohammad & Ingolfsson, Armann & Kolfal, Bora & Schultz, Kenneth, 2019. "Load effect on service times," European Journal of Operational Research, Elsevier, vol. 279(3), pages 673-686.
    12. Jiankun Sun & Dennis J. Zhang & Haoyuan Hu & Jan A. Van Mieghem, 2022. "Predicting Human Discretion to Adjust Algorithmic Prescription: A Large-Scale Field Experiment in Warehouse Operations," Management Science, INFORMS, vol. 68(2), pages 846-865, February.
    13. Hung T. Do & Masha Shunko & Marilyn T. Lucas & David C. Novak, 2018. "Impact of Behavioral Factors on Performance of Multi‐Server Queueing Systems," Production and Operations Management, Production and Operations Management Society, vol. 27(8), pages 1553-1573, August.
    14. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    15. Masha Shunko & Julie Niederhoff & Yaroslav Rosokha, 2018. "Humans Are Not Machines: The Behavioral Impact of Queueing Design on Service Time," Management Science, INFORMS, vol. 64(1), pages 453-473, January.
    16. Jiawei Li & Stephen Leider & Damian Beil & Izak Duenyas, 2021. "Running online experiments using web-conferencing software," Journal of the Economic Science Association, Springer;Economic Science Association, vol. 7(2), pages 167-183, December.
    17. Diwas Singh KC & Christian Terwiesch, 2012. "An Econometric Analysis of Patient Flows in the Cardiac Intensive Care Unit," Manufacturing & Service Operations Management, INFORMS, vol. 14(1), pages 50-65, January.
    18. Tamer Boyacı & Caner Canyakmaz & Francis de Véricourt, 2024. "Human and Machine: The Impact of Machine Input on Decision Making Under Cognitive Limitations," Management Science, INFORMS, vol. 70(2), pages 1258-1275, February.
    19. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    20. Diwas S. Kc & Christian Terwiesch, 2009. "Impact of Workload on Service Time and Patient Safety: An Econometric Analysis of Hospital Operations," Management Science, INFORMS, vol. 55(9), pages 1486-1498, September.
    21. Filiz, Ibrahim & Judek, Jan René & Lorenz, Marco & Spiwoks, Markus, 2021. "Reducing algorithm aversion through experience," Journal of Behavioral and Experimental Finance, Elsevier, vol. 31(C).
    22. Mitchell Hoffman & Lisa B Kahn & Danielle Li, 2018. "Discretion in Hiring," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 133(2), pages 765-800.
    23. Saravanan Kesavan & Tarun Kushwaha, 2020. "Field Experiment on the Profit Implications of Merchants’ Discretionary Power to Override Data-Driven Decision-Making Tools," Management Science, INFORMS, vol. 66(11), pages 5182-5190, November.
    24. Urs Fischbacher, 2007. "z-Tree: Zurich toolbox for ready-made economic experiments," Experimental Economics, Springer;Economic Science Association, vol. 10(2), pages 171-178, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Delasay, Mohammad & Ingolfsson, Armann & Kolfal, Bora & Schultz, Kenneth, 2019. "Load effect on service times," European Journal of Operational Research, Elsevier, vol. 279(3), pages 673-686.
    2. Ruth Beer & Anyan Qi & Ignacio Rios, 2026. "Behavioral Externalities of Process Automation," Management Science, INFORMS, vol. 72(1), pages 575-593, January.
    3. Diwas S. KC & Bradley R. Staats & Maryam Kouchaki & Francesca Gino, 2020. "Task Selection and Workload: A Focus on Completing Easy Tasks Hurts Performance," Management Science, INFORMS, vol. 66(10), pages 4397-4416, October.
    4. Felipe Caro & Jean-Edouard Colliard & Elena Katok & Axel Ockenfels & Nicolas Stier-Moses & Catherine Tucker & D. J. Wu, 2026. "Introduction to the Special Issue on the Human-Algorithm Connection," Management Science, INFORMS, vol. 72(1), pages 1-13, January.
    5. Brett Hathaway & Evgeny Kagan & John Jones, 2026. "One at a Time? The Personal Productivity Bias in Emergency Department Patient Assignment," Papers 2605.24208, arXiv.org.
    6. Mirko Kremer & Francis de Véricourt, 2022. "Mismanaging diagnostic accuracy under congestion," ESMT Research Working Papers ESMT-22-01, ESMT European School of Management and Technology.
    7. Büşra Ergün‐Şahin & Evrim Didem Güneş & Ayşe Kocabıyıkoğlu & Ahmet Keskin, 2022. "How does workload affect test ordering behavior of physicians? An empirical investigation," Production and Operations Management, Production and Operations Management Society, vol. 31(6), pages 2664-2680, June.
    8. Maria R. Ibanez & Jonathan R. Clark & Robert S. Huckman & Bradley R. Staats, 2018. "Discretionary Task Ordering: Queue Management in Radiological Services," Management Science, INFORMS, vol. 64(9), pages 4389-4407, September.
    9. Hummy Song & Mor Armony & Guillaume Roels, 2024. "Queue Configurations and Operational Performance: An Interplay Between Customer Ownership and Queue Length Awareness," Manufacturing & Service Operations Management, INFORMS, vol. 26(6), pages 2284-2304, November.
    10. Mohamad Soltani & Robert J. Batt & Hessam Bavafa & Brian W. Patterson, 2022. "Does What Happens in the ED Stay in the ED? The Effects of Emergency Department Physician Workload on Post-ED Care Use," Manufacturing & Service Operations Management, INFORMS, vol. 24(6), pages 3079-3098, November.
    11. Mirko Kremer & Francis de Véricourt, 2023. "Mismanaging Diagnostic Accuracy Under Congestion," Operations Research, INFORMS, vol. 71(3), pages 895-916, May.
    12. Xinyu Cao & Chenshan Hu & Jiankun Sun & Dennis J. Zhang, 2026. "How Forced Intervention Facilitates AI Adoption," Manufacturing & Service Operations Management, INFORMS, vol. 28(4), pages 1286-1306, July.
    13. Yueyang Zhong & Ragavendran Gopalakrishnan & Amy R. Ward, 2025. "Behavior-Aware Queueing: The Finite-Buffer Setting with Many Strategic Servers," Operations Research, INFORMS, vol. 73(1), pages 290-310, January.
    14. Brett A. Hathaway & Evgeny Kagan & Maqbool Dada, 2023. "The Gatekeeper’s Dilemma: “When Should I Transfer This Customer?”," Operations Research, INFORMS, vol. 71(3), pages 843-859, May.
    15. Julien Grand-Clément & Jean Pauphilet, 2026. "The Best Decisions Are Not the Best Advice: Making Adherence-Aware Recommendations," Management Science, INFORMS, vol. 72(1), pages 667-692, January.
    16. Yaroslav Rosokha & Chen Wei, 2024. "Cooperation in Queueing Systems," Management Science, INFORMS, vol. 70(11), pages 7597-7616, November.
    17. Robert J. Niewoehner & KC Diwas & Bradley Staats, 2023. "Physician Discretion and Patient Pick-up: How Familiarity Encourages Multitasking in the Emergency Department," Operations Research, INFORMS, vol. 71(3), pages 958-978, May.
    18. Michael Freeman & Nicos Savva & Stefan Scholtes, 2017. "Gatekeepers at Work: An Empirical Analysis of a Maternity Unit," Management Science, INFORMS, vol. 63(10), pages 3147-3167, October.
    19. Robert J. Batt & Christian Terwiesch, 2017. "Early Task Initiation and Other Load-Adaptive Mechanisms in the Emergency Department," Management Science, INFORMS, vol. 63(11), pages 3531-3551, November.
    20. Ruomeng Cui & Hao Ding & Feng Zhu, 2022. "Gender Inequality in Research Productivity During the COVID-19 Pandemic," Manufacturing & Service Operations Management, INFORMS, vol. 24(2), pages 707-726, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:72:y:2026:i:1:p:368-385. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.