IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v41y2025i2p440-451.html
   My bibliography  Save this article

Light-touch forecasting: A novel method to combine human judgment with statistical algorithms

Author

Listed:
  • van der Staak, B.B.J.P.J.
  • Basten, R.J.I.
  • van de Calseyde, P.P.F.M.
  • Demerouti, E.
  • de Kok, A.G.

Abstract

Forecast adjustments are an indispensable component of the forecasting process, but what is the most effective and efficient method to make these adjustments? Understanding how to effectively blend human forecast adjustments with statistical methods is of great importance as, even with the increased possibilities of AI, we can still not include all information available to a human planner. We address this issue by developing a method that builds on literature showing that some adjustments are consistently (in)accurate. More specifically, in two extensive case studies containing more than 3.5 million forecasting decisions, we confirm that planners are accurate in adjusting a statistical forecast in the right direction and determining the magnitude of downward adjustments, and they are inaccurate in determining the magnitude of upward adjustments. Leveraging these results, we introduce a novel method called light-touch forecasting, which attains performance levels similar to those of more traditional forecasting methods while minimizing the involvement of human planners. Furthermore, an online experiment shows an efficiency gain of 38% in terms of time spent on planning compared to traditional judgmental forecasting. We thus optimize the forecasting process by using the strengths of planners while avoiding their weaknesses.

Suggested Citation

  • van der Staak, B.B.J.P.J. & Basten, R.J.I. & van de Calseyde, P.P.F.M. & Demerouti, E. & de Kok, A.G., 2025. "Light-touch forecasting: A novel method to combine human judgment with statistical algorithms," International Journal of Forecasting, Elsevier, vol. 41(2), pages 440-451.
  • Handle: RePEc:eee:intfor:v:41:y:2025:i:2:p:440-451
    DOI: 10.1016/j.ijforecast.2024.04.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207024000347
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2024.04.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Eroglu, Cuneyt & Croxton, Keely L., 2010. "Biases in judgmental adjustments of statistical forecasts: The role of individual differences," International Journal of Forecasting, Elsevier, vol. 26(1), pages 116-133, January.
    2. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    3. Goodwin, Paul & Fildes, Robert & Lawrence, Michael & Stephens, Greg, 2011. "Restrictiveness and guidance in support systems," Omega, Elsevier, vol. 39(3), pages 242-253, June.
    4. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue Nov.
    5. Tava Lennon Olsen & Brian Tomlin, 2020. "Industry 4.0: Opportunities and Challenges for Operations Management," Manufacturing & Service Operations Management, INFORMS, vol. 22(1), pages 113-122, January.
    6. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    7. O'Connor, Marcus & Remus, William & Griggs, Ken, 1993. "Judgemental forecasting in times of change," International Journal of Forecasting, Elsevier, vol. 9(2), pages 163-172, August.
    8. M. J. Lawrence & R. H. Edmundson & M. J. O'Connor, 1986. "The Accuracy of Combining Judgemental and Statistical Forecasts," Management Science, INFORMS, vol. 32(12), pages 1521-1532, December.
    9. Fildes, Robert & Goodwin, Paul & Önkal, Dilek, 2019. "Use and misuse of information in supply chain forecasting of promotion effects," International Journal of Forecasting, Elsevier, vol. 35(1), pages 144-156.
    10. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    11. Khosrowabadi, Naghmeh & Hoberg, Kai & Imdahl, Christina, 2022. "Evaluating human behaviour in response to AI recommendations for judgemental forecasting," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1151-1167.
    12. Alvarado-Valencia, Jorge & Barrero, Lope H. & Önkal, Dilek & Dennerlein, Jack T., 2017. "Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(1), pages 298-313.
    13. Jonathon Karelse, 2021. "Mitigating Unconscious Bias in Forecasting," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 61, pages 5-14, Q2.
    14. Tashman, Leonard J., 2000. "Out-of-sample tests of forecasting accuracy: an analysis and review," International Journal of Forecasting, Elsevier, vol. 16(4), pages 437-450.
    15. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    16. Makridakis, Spyros & Spiliotis, Evangelos & Assimakopoulos, Vassilios, 2022. "The M5 competition: Background, organization, and implementation," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1325-1336.
    17. Robin M. Hogarth & Spyros Makridakis, 1981. "Forecasting and Planning: An Evaluation," Management Science, INFORMS, vol. 27(2), pages 115-138, February.
    18. Lawrence, Michael & O'Connor, Marcus & Edmundson, Bob, 2000. "A field study of sales forecasting accuracy and processes," European Journal of Operational Research, Elsevier, vol. 122(1), pages 151-160, April.
    19. Robert Fildes & Paul Goodwin, 2007. "Against Your Better Judgment? How Organizations Can Improve Their Use of Management Judgment in Forecasting," Interfaces, INFORMS, vol. 37(6), pages 570-576, December.
    20. Lawrence, Michael & O'Connor, Marcus, 1993. "Scale, Variability, and the Calibration of Judgmental Prediction Intervals," Organizational Behavior and Human Decision Processes, Elsevier, vol. 56(3), pages 441-458, December.
    21. Yun Shin Lee & Yong Won Seo & Enno Siemsen, 2018. "Running Behavioral Operations Experiments Using Amazon's Mechanical Turk," Production and Operations Management, Production and Operations Management Society, vol. 27(5), pages 973-989, May.
    22. Franses, Philip Hans, 2013. "Improving judgmental adjustment of model-based forecasts," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 1-8.
    23. Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
    24. Lawrence, Michael J. & Edmundson, Robert H. & O'Connor, Marcus J., 1985. "An examination of the accuracy of judgmental extrapolation of time series," International Journal of Forecasting, Elsevier, vol. 1(1), pages 25-35.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    2. Fahimnia, Ben & Tan, Tarkan & Tahirov, Nail, 2025. "Service-level anchoring in demand forecasting: The moderating impact of retail promotions and product perishability," International Journal of Forecasting, Elsevier, vol. 41(2), pages 554-570.
    3. Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
    4. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    5. Fildes, Robert & Goodwin, Paul & De Baets, Shari, 2025. "Forecast value added in demand planning," International Journal of Forecasting, Elsevier, vol. 41(2), pages 649-669.
    6. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    7. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    8. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    9. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    10. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    11. Khosrowabadi, Naghmeh & Hoberg, Kai & Lee, Yun Shin, 2025. "Guiding supervisors in artificial intelligence-enabled forecasting: Understanding the impacts of salience and detail on decision-making," International Journal of Forecasting, Elsevier, vol. 41(2), pages 716-732.
    12. Petropoulos, Fotios & Spiliotis, Evangelos, 2025. "Judgmental selection of parameters for simple forecasting models," European Journal of Operational Research, Elsevier, vol. 323(3), pages 780-794.
    13. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    14. Khosrowabadi, Naghmeh & Hoberg, Kai & Imdahl, Christina, 2022. "Evaluating human behaviour in response to AI recommendations for judgemental forecasting," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1151-1167.
    15. De Baets, Shari & Harvey, Nigel, 2020. "Using judgment to select and adjust forecasts from statistical models," European Journal of Operational Research, Elsevier, vol. 284(3), pages 882-895.
    16. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    17. Abolghasemi, Mahdi & Ganbold, Odkhishig & Rotaru, Kristian, 2025. "Humans vs. large language models: Judgmental forecasting in an era of advanced AI," International Journal of Forecasting, Elsevier, vol. 41(2), pages 631-648.
    18. Cedric A. Lehmann & Christiane B. Haubitz & Andreas Fügener & Ulrich W. Thonemann, 2022. "The risk of algorithm transparency: How algorithm complexity drives the effects on the use of advice," Production and Operations Management, Production and Operations Management Society, vol. 31(9), pages 3419-3434, September.
    19. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2022. "Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1283-1318.
    20. Katsagounos, Ilias & Thomakos, Dimitrios D. & Litsiou, Konstantia & Nikolopoulos, Konstantinos, 2021. "Superforecasting reality check: Evidence from a small pool of experts and expedited identification," European Journal of Operational Research, Elsevier, vol. 289(1), pages 107-117.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:41:y:2025:i:2:p:440-451. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.