An overview of the effects of algorithm use on judgmental biases affecting forecasting
Author
Abstract
Suggested Citation
DOI: 10.1016/j.ijforecast.2024.09.007
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- Eroglu, Cuneyt & Croxton, Keely L., 2010. "Biases in judgmental adjustments of statistical forecasts: The role of individual differences," International Journal of Forecasting, Elsevier, vol. 26(1), pages 116-133, January.
- Michele Trovero & Spiros Potamitis, 2023. "How Will Generative AI Influence Forecasting Software?," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 71, pages 55-61, Q4.
- Kuncel, Nathan R., 2008. "Some New (and Old) Suggestions for Improving Personnel Selection," Industrial and Organizational Psychology, Cambridge University Press, vol. 1(3), pages 343-346, September.
- Sanders, Nada R. & Manrodt, Karl B., 2003. "The efficacy of using judgmental versus quantitative forecasting methods in practice," Omega, Elsevier, vol. 31(6), pages 511-522, December.
- Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
- Whitecotton, Stacey M., 1996. "The Effects of Experience and a Decision Aid on the Slope, Scatter, and Bias of Earnings Forecasts," Organizational Behavior and Human Decision Processes, Elsevier, vol. 66(1), pages 111-121, April.
- Arkes, Hal R. & Dawes, Robyn M. & Christensen, Caryn, 1986. "Factors influencing the use of a decision rule in a probabilistic task," Organizational Behavior and Human Decision Processes, Elsevier, vol. 37(1), pages 93-110, February.
- Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
- Paul Goodwin & M. Sinan Gonul & Dilek Onkal, 2022. "Commentary on "Making Forecasts More Trustworthy"," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 66, pages 26-29, Q3.
- Deepa, R. & Sekar, Srinivasan & Malik, Ashish & Kumar, Jitender & Attri, Rekha, 2024. "Impact of AI-focussed technologies on social and technical competencies for HR managers – A systematic review and research agenda," Technological Forecasting and Social Change, Elsevier, vol. 202(C).
- Shari Baets & Nigel Harvey, 2023. "Incorporating External Factors into Time Series Forecasts," International Series in Operations Research & Management Science, in: Matthias Seifert (ed.), Judgment in Predictive Analytics, chapter 0, pages 265-287, Springer.
- Fildes, Robert & Goodwin, Paul, 2021. "Stability in the inefficient use of forecasting systems: A case study in a supply chain company," International Journal of Forecasting, Elsevier, vol. 37(2), pages 1031-1046.
- Dilek Önkal & M. Sinan Gönül & Paul Goodwin, 2023. "Supporting Judgment in Predictive Analytics: Scenarios and Judgmental Forecasts," International Series in Operations Research & Management Science, in: Matthias Seifert (ed.), Judgment in Predictive Analytics, chapter 0, pages 245-264, Springer.
- Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
- Andrew Prahl & Lyn Van Swol, 2017. "Understanding algorithm aversion: When is advice from automation discounted?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(6), pages 691-702, September.
- Fildes, Robert & Goodwin, Paul & Önkal, Dilek, 2019. "Use and misuse of information in supply chain forecasting of promotion effects," International Journal of Forecasting, Elsevier, vol. 35(1), pages 144-156.
- Wright, George & Lawrence, Michael J. & Collopy, Fred, 1996. "The role and validity of judgment in forecasting," International Journal of Forecasting, Elsevier, vol. 12(1), pages 1-8, March.
- Matthias Seifert & Enno Siemsen & Allègre L. Hadida & Andreas E. Eisingerich, 2023. "Effective Judgmental Forecasting in the Context of Fashion Products (Reprint)," International Series in Operations Research & Management Science, in: Matthias Seifert (ed.), Judgment in Predictive Analytics, chapter 0, pages 85-114, Springer.
- Baoying Shan & Ping Guo & Shanshan Guo & Zhong Li, 2019. "A Price-Forecast-Based Irrigation Scheduling Optimization Model under the Response of Fruit Quality and Price to Water," Sustainability, MDPI, vol. 11(7), pages 1-21, April.
- Makridakis, Spyros, 1988. "Metaforecasting : Ways of improving forecasting accuracy and usefulness," International Journal of Forecasting, Elsevier, vol. 4(3), pages 467-491.
- Fildes, Robert & Petropoulos, Fotios, 2015. "Simple versus complex selection rules for forecasting many time series," Journal of Business Research, Elsevier, vol. 68(8), pages 1692-1701.
- Spyros Makridakis & Fotios Petropoulos & Yanfei Kang, 2023. "Large Language Models: Their Success and Impact," Forecasting, MDPI, vol. 5(3), pages 1-14, August.
- Logg, Jennifer M. & Minson, Julia A. & Moore, Don A., 2019. "Algorithm appreciation: People prefer algorithmic to human judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 151(C), pages 90-103.
- Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
- Esther Kaufmann, 2024. "Teachers’ judgment accuracy: A replication check by psychometric meta-analysis," PLOS ONE, Public Library of Science, vol. 19(7), pages 1-18, July.
- De Baets, Shari & Harvey, Nigel, 2020. "Using judgment to select and adjust forecasts from statistical models," European Journal of Operational Research, Elsevier, vol. 284(3), pages 882-895.
- Önkal, Dilek & Sinan Gönül, M. & Goodwin, Paul & Thomson, Mary & Öz, Esra, 2017. "Evaluating expert advice in forecasting: Users’ reactions to presumed vs. experienced credibility," International Journal of Forecasting, Elsevier, vol. 33(1), pages 280-297.
- Esther Kaufmann & Werner W Wittmann, 2016. "The Success of Linear Bootstrapping Models: Decision Domain-, Expertise-, and Criterion-Specific Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-21, June.
- Robert Fildes & Paul Goodwin, 2007. "Against Your Better Judgment? How Organizations Can Improve Their Use of Management Judgment in Forecasting," Interfaces, INFORMS, vol. 37(6), pages 570-576, December.
- Lackes, Richard & Siepermann, Markus & Vetter, Georg, 2020. "What drives decision makers to follow or ignore forecasting tools - A game based analysis," Journal of Business Research, Elsevier, vol. 106(C), pages 315-322.
- Haefner, Naomi & Parida, Vinit & Gassmann, Oliver & Wincent, Joakim, 2023. "Implementing and scaling artificial intelligence: A review, framework, and research agenda," Technological Forecasting and Social Change, Elsevier, vol. 197(C).
- Achiel Fenneman & Joern Sickmann & Thomas Pitz & Alan G Sanfey, 2021. "Two distinct and separable processes underlie individual differences in algorithm adherence: Differences in predictions and differences in trust thresholds," PLOS ONE, Public Library of Science, vol. 16(2), pages 1-20, February.
- Phillips, Jean M. & Gully, Stanley M., 2008. "The Role of Perceptions Versus Reality in Managers’ Choice of Selection Decision Aids," Industrial and Organizational Psychology, Cambridge University Press, vol. 1(3), pages 361-363, September.
- Jason W. Burton & Mari-Klara Stein & Tina Blegind Jensen, 2023. "Beyond Algorithm Aversion in Human-Machine Decision-Making," International Series in Operations Research & Management Science, in: Matthias Seifert (ed.), Judgment in Predictive Analytics, chapter 0, pages 3-26, Springer.
- Helin Jia & Wei Wang, 2021. "Deep Learning Algorithm-Based Financial Prediction Models," Complexity, Hindawi, vol. 2021, pages 1-9, March.
- Laurie Swinney, 1999. "Consideration of the social context of auditors’ reliance on expert system output during evaluation of loan loss reserves," Intelligent Systems in Accounting, Finance and Management, John Wiley & Sons, Ltd., vol. 8(3), pages 199-213, September.
- Mahmud, Hasan & Islam, A.K.M. Najmul & Ahmed, Syed Ishtiaque & Smolander, Kari, 2022. "What influences algorithmic decision-making? A systematic literature review on algorithm aversion," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
- James H. Barnes, 1984. "Cognitive biases and their impact on strategic planning," Strategic Management Journal, Wiley Blackwell, vol. 5(2), pages 129-137, April.
- Litterscheidt, Rouven & Streich, David J., 2020. "Financial education and digital asset management: What's in the black box?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 87(C).
- Kris Johnson Ferreira & Bin Hong Alex Lee & David Simchi-Levi, 2016. "Analytics for an Online Retailer: Demand Forecasting and Price Optimization," Manufacturing & Service Operations Management, INFORMS, vol. 18(1), pages 69-88, February.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022.
"Forecasting: theory and practice,"
International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
- Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
- Abolghasemi, Mahdi & Ganbold, Odkhishig & Rotaru, Kristian, 2025. "Humans vs. large language models: Judgmental forecasting in an era of advanced AI," International Journal of Forecasting, Elsevier, vol. 41(2), pages 631-648.
- Mahmud, Hasan & Islam, A.K.M. Najmul & Ahmed, Syed Ishtiaque & Smolander, Kari, 2022. "What influences algorithmic decision-making? A systematic literature review on algorithm aversion," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
- Fahimnia, Ben & Tan, Tarkan & Tahirov, Nail, 2025. "Service-level anchoring in demand forecasting: The moderating impact of retail promotions and product perishability," International Journal of Forecasting, Elsevier, vol. 41(2), pages 554-570.
- Fildes, Robert & Goodwin, Paul & De Baets, Shari, 2025. "Forecast value added in demand planning," International Journal of Forecasting, Elsevier, vol. 41(2), pages 649-669.
- Khosrowabadi, Naghmeh & Hoberg, Kai & Imdahl, Christina, 2022. "Evaluating human behaviour in response to AI recommendations for judgemental forecasting," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1151-1167.
- Harvey, Nigel & De Baets, Shari, 2025. "Factors affecting preferences between judgmental and algorithmic forecasts: Feedback, guidance and labeling effects," International Journal of Forecasting, Elsevier, vol. 41(2), pages 532-553.
- Christiane B. Haubitz & Cedric A. Lehmann & Andreas Fügener & Ulrich W. Thonemann, 2021. "The Risk of Algorithm Transparency: How Algorithm Complexity Drives the Effects on Use of Advice," ECONtribute Discussion Papers Series 078, University of Bonn and University of Cologne, Germany.
- Khosrowabadi, Naghmeh & Hoberg, Kai & Lee, Yun Shin, 2025. "Guiding supervisors in artificial intelligence-enabled forecasting: Understanding the impacts of salience and detail on decision-making," International Journal of Forecasting, Elsevier, vol. 41(2), pages 716-732.
- Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
- Cedric A. Lehmann & Christiane B. Haubitz & Andreas Fügener & Ulrich W. Thonemann, 2022. "The risk of algorithm transparency: How algorithm complexity drives the effects on the use of advice," Production and Operations Management, Production and Operations Management Society, vol. 31(9), pages 3419-3434, September.
- Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
- Wang, Xun & Rodrigues, Vasco Sanchez & Demir, Emrah & Sarkis, Joseph, 2024. "Algorithm aversion during disruptions: The case of safety stock," International Journal of Production Economics, Elsevier, vol. 278(C).
- Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
- Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
- van der Staak, B.B.J.P.J. & Basten, R.J.I. & van de Calseyde, P.P.F.M. & Demerouti, E. & de Kok, A.G., 2025. "Light-touch forecasting: A novel method to combine human judgment with statistical algorithms," International Journal of Forecasting, Elsevier, vol. 41(2), pages 440-451.
- Hewage, Harsha Chamara & Perera, H. Niles & De Baets, Shari, 2022. "Forecast adjustments during post-promotional periods," European Journal of Operational Research, Elsevier, vol. 300(2), pages 461-472.
- Petropoulos, Fotios & Spiliotis, Evangelos, 2025. "Judgmental selection of parameters for simple forecasting models," European Journal of Operational Research, Elsevier, vol. 323(3), pages 780-794.
- Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019.
"Judgmental forecast adjustments over different time horizons,"
Omega, Elsevier, vol. 87(C), pages 34-45.
- Maud van den Broeke & Shari de Baets & Ann Vereecke & Philippe Baecke & Karlien Vanderheyden, 2019. "Judgmental forecast adjustments over different time horizons," Post-Print hal-03001747, HAL.
- Thomson, Mary E. & Pollock, Andrew C. & Gönül, M. Sinan & Önkal, Dilek, 2013. "Effects of trend strength and direction on performance and consistency in judgmental exchange rate forecasting," International Journal of Forecasting, Elsevier, vol. 29(2), pages 337-353.
More about this item
Keywords
Judgmental biases; Algorithm use; Judgmental accuracy; Judgmental forecasting; Judgmental adjustment; Review article;All these keywords.
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:41:y:2025:i:2:p:424-439. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.