IDEAS home Printed from https://ideas.repec.org/a/spr/jmgtco/v32y2021i4d10.1007_s00187-021-00326-3.html
   My bibliography  Save this article

Towards a better understanding on mitigating algorithm aversion in forecasting: an experimental study

Author

Listed:
  • Markus Jung

    (Ulm University)

  • Mischa Seiter

    (Ulm University)

Abstract

Forecasts serve as the basis for a wide range of managerial decisions. With the potential of new data sources and new techniques for data analysis, human forecasters are increasingly interacting with algorithms. Although algorithms can show better forecasting performance than humans, forecasters do not always accept these algorithms and instead show aversion to them. Algorithm aversion has become a widely known phenomenon. Drawing on the seminal study of Dietvorst et al. (J Exp Psychol Gen 144(1):114–126, 2015), we extend the evidence on algorithm aversion by introducing three environmental variables from the management accounting literature. We argue that time pressure, “do your best” goals, and forecasters’ data input decision rights on the algorithms input mitigate algorithm aversion. To test our hypotheses, we conducted an experimental study with 1,840 participants overall. We found support for our hypothesis that time pressure mitigates algorithm aversion. We found evidence that the mitigation effect is based on forecasters’ loss of confidence in their own forecast when they are under time pressure. We found no support for our hypothesis on “do your best” goals or forecasters’ data input decision rights.

Suggested Citation

  • Markus Jung & Mischa Seiter, 2021. "Towards a better understanding on mitigating algorithm aversion in forecasting: an experimental study," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 32(4), pages 495-516, December.
  • Handle: RePEc:spr:jmgtco:v:32:y:2021:i:4:d:10.1007_s00187-021-00326-3
    DOI: 10.1007/s00187-021-00326-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00187-021-00326-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00187-021-00326-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Remus, William & O'Connor, Marcus & Griggs, Kenneth, 1995. "Does reliable information improve the accuracy of judgmental forecasts?," International Journal of Forecasting, Elsevier, vol. 11(2), pages 285-293, June.
    2. Highhouse, Scott, 2008. "Stubborn Reliance on Intuition and Subjectivity in Employee Selection," Industrial and Organizational Psychology, Cambridge University Press, vol. 1(3), pages 333-342, September.
    3. Oriana Bandiera & Iwan Barankay & Imran Rasul, 2013. "Team Incentives: Evidence From A Firm Level Experiment," Journal of the European Economic Association, European Economic Association, vol. 11(5), pages 1079-1114, October.
    4. Bonner, Sarah E. & Sprinkle, Geoffrey B., 2002. "The effects of monetary incentives on effort and task performance: theories, evidence, and a framework for research," Accounting, Organizations and Society, Elsevier, vol. 27(4-5), pages 303-345.
    5. Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
    6. Zafer Akın & Emin Karagözoğlu, 2017. "The Role of Goals and Feedback in Incentivizing Performance," Managerial and Decision Economics, John Wiley & Sons, Ltd., vol. 38(2), pages 193-211, March.
    7. Baiman, Stanley, 1990. "Agency research in managerial accounting: A second look," Accounting, Organizations and Society, Elsevier, vol. 15(4), pages 341-371.
    8. Choi, Darwin & Hui, Sam K., 2014. "The role of surprise: Understanding overreaction and underreaction to unanticipated events using in-play soccer betting market," Journal of Economic Behavior & Organization, Elsevier, vol. 107(PB), pages 614-629.
    9. Guoli Chen & Craig Crossland & Shuqing Luo, 2015. "Making the same mistake all over again: CEO overconfidence and corporate resistance to corrective feedback," Strategic Management Journal, Wiley Blackwell, vol. 36(10), pages 1513-1535, October.
    10. Chen, Clara Xiaoling & Rennekamp, Kristina M. & Zhou, Flora H., 2015. "The effects of forecast type and performance-based incentives on the quality of management forecasts," Accounting, Organizations and Society, Elsevier, vol. 46(C), pages 8-18.
    11. Butler, Stephen A. & Ghosh, Dipankar, 2015. "Individual differences in managerial accounting judgments and decision making," The British Accounting Review, Elsevier, vol. 47(1), pages 33-45.
    12. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    13. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    14. Pete Wegier & Julia Spaniol, 2015. "The Effect of Time Pressure on Risky Financial Decisions from Description and Decisions from Experience," PLOS ONE, Public Library of Science, vol. 10(4), pages 1-16, April.
    15. Leonidas Spiliopoulos & Andreas Ortmann, 2018. "The BCD of response time analysis in experimental economics," Experimental Economics, Springer;Economic Science Association, vol. 21(2), pages 383-433, June.
    16. Lambert, Tamara A. & Jones, Keith L. & Brazel, Joseph F. & Showalter, D. Scott, 2017. "Audit time pressure and earnings quality: An examination of accelerated filings," Accounting, Organizations and Society, Elsevier, vol. 58(C), pages 50-66.
    17. Luft, Joan, 2016. "Management accounting in the laboratory and in social context: Four contrasts, 1975–2014," Accounting, Organizations and Society, Elsevier, vol. 49(C), pages 9-20.
    18. Robert Carbone & Allan Andersen & Yvan Corriveau & Paul Piat Corson, 1983. "Comparing for Different Time Series Methods the Value of Technical Expertise Individualized Analysis, and Judgmental Adjustment," Management Science, INFORMS, vol. 29(5), pages 559-566, May.
    19. Appelbaum, Deniz & Kogan, Alexander & Vasarhelyi, Miklos & Yan, Zhaokai, 2017. "Impact of business analytics and enterprise systems on managerial accounting," International Journal of Accounting Information Systems, Elsevier, vol. 25(C), pages 29-44.
    20. Viswanath Venkatesh & Fred D. Davis, 2000. "A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies," Management Science, INFORMS, vol. 46(2), pages 186-204, February.
    21. Andrew Prahl & Lyn Van Swol, 2017. "Understanding algorithm aversion: When is advice from automation discounted?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(6), pages 691-702, September.
    22. Colin F. Camerer & Teck-Hua Ho & Juin-Kuan Chong, 2004. "A Cognitive Hierarchy Model of Games," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(3), pages 861-898.
    23. Ashton, Rh, 1990. "Pressure And Performance In Accounting Decision Settings - Paradoxical Effects Of Incentives, Feedback, And Justification," Journal of Accounting Research, Wiley Blackwell, vol. 28, pages 148-180.
    24. Gianluca Vitale & Sebastiano Cupertino & Angelo Riccaboni, 2020. "Big data and management control systems change: the case of an agricultural SME," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 31(1), pages 123-152, April.
    25. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    26. Wood, Robert & Bandura, Albert & Bailey, Trevor, 1990. "Mechanisms governing organizational performance in complex decision-making environments," Organizational Behavior and Human Decision Processes, Elsevier, vol. 46(2), pages 181-201, August.
    27. Bandiera, Oriana & Barankay, Iwan & Rasul, Imran, 2013. "Team incentives: evidence from a firm level," LSE Research Online Documents on Economics 53141, London School of Economics and Political Science, LSE Library.
    28. Grieco, Daniela & Hogarth, Robin M., 2009. "Overconfidence in absolute and relative performance: The regression hypothesis and Bayesian updating," Journal of Economic Psychology, Elsevier, vol. 30(5), pages 756-771, October.
    29. Khaldoon Al-Htaybat & Larissa von Alberti-Alhtaybat, 2017. "Big Data and corporate reporting: impacts and paradoxes," Accounting, Auditing & Accountability Journal, Emerald Group Publishing Limited, vol. 30(4), pages 850-873, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Benedikt Berger & Martin Adam & Alexander Rühr & Alexander Benlian, 2021. "Watch Me Improve—Algorithm Aversion and Demonstrating the Ability to Learn," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(1), pages 55-68, February.
    2. Robert M. Gillenkirch & Julia Ortner & Sebastian Robert & Louis Velthuis, 2023. "Designing incentives and performance measurement for advisors: How to make decision-makers listen to advice," Working Papers 2304, Gutenberg School of Management and Economics, Johannes Gutenberg-Universität Mainz.
    3. Zulia Gubaydullina & Jan René Judek & Marco Lorenz & Markus Spiwoks, 2022. "Comparing Different Kinds of Influence on an Algorithm in Its Forecasting Process and Their Impact on Algorithm Aversion," Businesses, MDPI, vol. 2(4), pages 1-23, October.
    4. Greiner, Ben & Grünwald, Philipp & Lindner, Thomas & Lintner, Georg & Wiernsperger, Martin, 2024. "Incentives, Framing, and Reliance on Algorithmic Advice: An Experimental Study," Department for Strategy and Innovation Working Paper Series 01/2024, WU Vienna University of Economics and Business.
    5. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    6. Henry Eyring & Patrick J. Ferguson & Sebastian Koppers, 2021. "Less Information, More Comparison, and Better Performance: Evidence from a Field Experiment," Journal of Accounting Research, Wiley Blackwell, vol. 59(2), pages 657-711, May.
    7. Mathieu Chevrier & Brice Corgnet & Eric Guerci & Julie Rosaz, 2024. "Algorithm Credulity: Human and Algorithmic Advice in Prediction Experiments," GREDEG Working Papers 2024-03, Groupe de REcherche en Droit, Economie, Gestion (GREDEG CNRS), Université Côte d'Azur, France.
    8. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    9. Bauer, Kevin & von Zahn, Moritz & Hinz, Oliver, 2022. "Expl(AI)ned: The impact of explainable Artificial Intelligence on cognitive processes," SAFE Working Paper Series 315, Leibniz Institute for Financial Research SAFE, revised 2022.
    10. Mahmud, Hasan & Islam, A.K.M. Najmul & Ahmed, Syed Ishtiaque & Smolander, Kari, 2022. "What influences algorithmic decision-making? A systematic literature review on algorithm aversion," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    11. Merle, Aurélie & St-Onge, Anik & Sénécal, Sylvain, 2022. "Does it pay to be honest? The effect of retailer-provided negative feedback on consumers’ product choice and shopping experience," Journal of Business Research, Elsevier, vol. 147(C), pages 532-543.
    12. Fildes, Robert & Goodwin, Paul, 2021. "Stability in the inefficient use of forecasting systems: A case study in a supply chain company," International Journal of Forecasting, Elsevier, vol. 37(2), pages 1031-1046.
    13. Christoph Keding, 2021. "Understanding the interplay of artificial intelligence and strategic management: four decades of research in review," Management Review Quarterly, Springer, vol. 71(1), pages 91-134, February.
    14. Jochen Fähndrich, 2023. "A literature review on the impact of digitalisation on management control," Journal of Management Control: Zeitschrift für Planung und Unternehmenssteuerung, Springer, vol. 34(1), pages 9-65, March.
    15. Alexia GAUDEUL & Caterina GIANNETTI, 2023. "Trade-offs in the design of financial algorithms," Discussion Papers 2023/288, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.
    16. Mahmud, Hasan & Islam, A.K.M. Najmul & Mitra, Ranjan Kumar, 2023. "What drives managers towards algorithm aversion and how to overcome it? Mitigating the impact of innovation resistance through technology readiness," Technological Forecasting and Social Change, Elsevier, vol. 193(C).
    17. Chugunova, Marina & Sele, Daniela, 2022. "We and It: An interdisciplinary review of the experimental evidence on how humans interact with machines," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 99(C).
    18. Buffat, Justin & Praxmarer, Matthias & Sutter, Matthias, 2023. "The intrinsic value of decision rights: A replication and an extension to team decision making," Journal of Economic Behavior & Organization, Elsevier, vol. 209(C), pages 560-571.
    19. Adnan Q. Khan & Asim Ijaz Khwaja & Benjamin A. Olken, 2019. "Making Moves Matter: Experimental Evidence on Incentivizing Bureaucrats through Performance-Based Postings," American Economic Review, American Economic Association, vol. 109(1), pages 237-270, January.
    20. Delavallade, Clara, 2021. "Motivating teams: Private feedback and public recognition at work," Journal of Public Economics, Elsevier, vol. 197(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jmgtco:v:32:y:2021:i:4:d:10.1007_s00187-021-00326-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.