IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v37y2021i2p1031-1046.html
   My bibliography  Save this article

Stability in the inefficient use of forecasting systems: A case study in a supply chain company

Author

Listed:
  • Fildes, Robert
  • Goodwin, Paul

Abstract

Computer-based demand forecasting systems have been widely adopted in supply chain companies, but little research has studied how these systems are actually used in the forecasting process. We report the findings of a case study of demand forecasting in a pharmaceutical company over a 15-year period. At the start of the study, managers believed that they were making extensive use of their forecasting system that was marketed based on the accuracy of its advanced statistical methods. Yet most forecasts were obtained using the system’s facility for judgmentally overriding the automatic statistical forecasts. Carrying out the judgmental interventions involved considerable management effort as part of a sales & operations planning (S&OP) process, yet these often only served to reduce forecast accuracy. This study uses observations of the forecasting process, interviews with participants and data on the accuracy of forecasts to investigate why the managers continued to use non-normative forecasting practices for many years despite the potential economic benefits that could be achieved through change. The reasons for the longevity of these practices are examined both from the perspective of the individual forecaster and the organization as a whole.

Suggested Citation

  • Fildes, Robert & Goodwin, Paul, 2021. "Stability in the inefficient use of forecasting systems: A case study in a supply chain company," International Journal of Forecasting, Elsevier, vol. 37(2), pages 1031-1046.
  • Handle: RePEc:eee:intfor:v:37:y:2021:i:2:p:1031-1046
    DOI: 10.1016/j.ijforecast.2020.11.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207020301801
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2020.11.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Smith, Carlo D. & Mentzer, John T., 2010. "Forecasting task-technology fit: The influence of individuals, systems and procedures on forecast performance," International Journal of Forecasting, Elsevier, vol. 26(1), pages 144-161, January.
    2. De Baets, Shari & Harvey, Nigel, 2018. "Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support," International Journal of Forecasting, Elsevier, vol. 34(2), pages 163-180.
    3. Klassen, Robert D. & Flores, Benito E., 2001. "Forecasting practices of Canadian firms: Survey results and comparisons," International Journal of Production Economics, Elsevier, vol. 70(2), pages 163-174, March.
    4. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    5. Winklhofer, Heidi & Diamantopoulos, Adamantios & Witt, Stephen F., 1996. "Forecasting practice: A review of the empirical literature and an agenda for future research," International Journal of Forecasting, Elsevier, vol. 12(2), pages 193-221, June.
    6. Kottemann, Jeffrey E. & Davis, Fred D. & Remus, William E., 1994. "Computer-Assisted Decision Making: Performance, Beliefs, and the Illusion of Control," Organizational Behavior and Human Decision Processes, Elsevier, vol. 57(1), pages 26-37, January.
    7. Tuomikangas, Nina & Kaipia, Riikka, 2014. "A coordination framework for sales and operations planning (S&OP): Synthesis from the literature," International Journal of Production Economics, Elsevier, vol. 154(C), pages 243-262.
    8. Yaniv, Ilan & Kleinberger, Eli, 2000. "Advice Taking in Decision Making: Egocentric Discounting and Reputation Formation," Organizational Behavior and Human Decision Processes, Elsevier, vol. 83(2), pages 260-281, November.
    9. Mady, M. Tawfik, 2000. "Sales forecasting practices of Egyptian public enterprises: survey evidence," International Journal of Forecasting, Elsevier, vol. 16(3), pages 359-368.
    10. John Mello, 2009. "The Impact of Sales Forecast Game Playing on Supply Chains," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 13, pages 13-22, Spring.
    11. Paul Goodwin, 2015. "Commentary #2: Where Is the Support for Judgment?," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 39, pages 14-15, Fall.
    12. Asimakopoulos, Stavros & Dix, Alan, 2013. "Forecasting support systems technologies-in-practice: A model of adoption and use for product forecasting," International Journal of Forecasting, Elsevier, vol. 29(2), pages 322-336.
    13. De Baets, Shari & Harvey, Nigel, 2020. "Using judgment to select and adjust forecasts from statistical models," European Journal of Operational Research, Elsevier, vol. 284(3), pages 882-895.
    14. Moon, Mark A. & Mentzer, John T. & Smith, Carlo D., 2003. "Conducting a sales forecasting audit," International Journal of Forecasting, Elsevier, vol. 19(1), pages 5-25.
    15. Goodwin, Paul & Fildes, Robert & Lawrence, Michael & Stephens, Greg, 2011. "Restrictiveness and guidance in support systems," Omega, Elsevier, vol. 39(3), pages 242-253, June.
    16. Stephen J. Hoch & David A. Schkade, 1996. "A Psychological Approach to Decision Support Systems," Management Science, INFORMS, vol. 42(1), pages 51-64, January.
    17. Ruivo, Pedro & Oliveira, Tiago & Neto, Miguel, 2014. "Examine ERP post-implementation stages of use and value: Empirical evidence from Portuguese SMEs," International Journal of Accounting Information Systems, Elsevier, vol. 15(2), pages 166-184.
    18. Goodwin, Paul, 2000. "Improving the voluntary integration of statistical forecasts and judgment," International Journal of Forecasting, Elsevier, vol. 16(1), pages 85-99.
    19. Berkeley J. Dietvorst & Joseph P. Simmons & Cade Massey, 2018. "Overcoming Algorithm Aversion: People Will Use Imperfect Algorithms If They Can (Even Slightly) Modify Them," Management Science, INFORMS, vol. 64(3), pages 1155-1170, March.
    20. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    21. Robert Fildes & Paul Goodwin, 2007. "Against Your Better Judgment? How Organizations Can Improve Their Use of Management Judgment in Forecasting," Interfaces, INFORMS, vol. 37(6), pages 570-576, December.
    22. Dalrymple, Douglas J., 1987. "Sales forecasting practices: Results from a United States survey," International Journal of Forecasting, Elsevier, vol. 3(3-4), pages 379-391.
    23. repec:cup:judgdm:v:1:y:2006:i::p:23-32 is not listed on IDEAS
    24. Dilek Onkal & M. Sinan Gonul, 2005. "Judgmental Adjustment: A Challenge for Providers and Users of Forecasts," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 1, pages 13-17, June.
    25. Donna F. Davis & John T. Mentzer & Teresa M. Mccarthy & Susan L. Golicic, 2006. "The evolution of sales forecasting management: a 20-year longitudinal study of forecasting practices," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(5), pages 303-324.
    26. O'Connor, Marcus & Remus, William & Griggs, Ken, 1993. "Judgemental forecasting in times of change," International Journal of Forecasting, Elsevier, vol. 9(2), pages 163-172, August.
    27. Phillips, Christina Jane & Nikolopoulos, Konstantinos, 2019. "Forecast quality improvement with Action Research: A success story at PharmaCo," International Journal of Forecasting, Elsevier, vol. 35(1), pages 129-143.
    28. Michael Siegrist & George T. Cvetkovich & Heinz Gutscher, 2001. "Shared Values, Social Trust, and the Perception of Geographic Cancer Clusters," Risk Analysis, John Wiley & Sons, vol. 21(6), pages 1047-1054, December.
    29. Andrew Prahl & Lyn Van Swol, 2017. "Understanding algorithm aversion: When is advice from automation discounted?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(6), pages 691-702, September.
    30. Davydenko, Andrey & Fildes, Robert, 2013. "Measuring forecasting accuracy: The case of judgmental adjustments to SKU-level demand forecasts," International Journal of Forecasting, Elsevier, vol. 29(3), pages 510-522.
    31. Franses, Philip Hans & Legerstee, Rianne, 2013. "Do statistical forecasting models for SKU-level data benefit from including past expert knowledge?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 80-87.
    32. Robert Fildes & Paul Goodwin, 2007. "Good and Bad Judgment in Forecasting: Lessons from Four Companies," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 8, pages 5-10, Fall.
    33. Siegel, Jane & Dubrovsky, Vitaly & Kiesler, Sara & McGuire, Timothy W., 1986. "Group processes in computer-mediated communication," Organizational Behavior and Human Decision Processes, Elsevier, vol. 37(2), pages 157-187, April.
    34. Robert Fildes & Fotios Petropoulos, 2015. "Improving Forecast Quality in Practice," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 36, pages 5-12, Winter.
    35. Justus Heuer & Christoph Merkle & Martin Weber, 2017. "Fooled by Randomness: Investor Perception of Fund Manager Skill," Review of Finance, European Finance Association, vol. 21(2), pages 605-635.
    36. Franses, Philip Hans & Legerstee, Rianne, 2009. "Properties of expert adjustments on model-based SKU-level forecasts," International Journal of Forecasting, Elsevier, vol. 25(1), pages 35-47.
    37. Wanda J. Orlikowski, 1992. "The Duality of Technology: Rethinking the Concept of Technology in Organizations," Organization Science, INFORMS, vol. 3(3), pages 398-427, August.
    38. Goodwin, Paul, 2002. "Integrating management judgment and statistical methods to improve short-term forecasts," Omega, Elsevier, vol. 30(2), pages 127-135, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anna Borucka, 2023. "Seasonal Methods of Demand Forecasting in the Supply Chain as Support for the Company’s Sustainable Growth," Sustainability, MDPI, vol. 15(9), pages 1-21, April.
    2. Andrey Davydenko & Paul Goodwin, 2021. "Bewertung der Verzerrung von Punktprognosen über mehrere Zeitreihen hinweg: Maßnahmen und visuelle Werkzeuge [Assessing point forecast bias across multiple time series: Measures and visual tools]," Post-Print hal-03359179, HAL.
    3. Andrey Davydenko & Paul Goodwin, 2021. "Assessing Point Forecast Bias Across Multiple Time Series: Measures and Visual Tools," International Journal of Statistics and Probability, Canadian Center of Science and Education, vol. 10(5), pages 1-46, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    4. Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
    5. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    6. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    7. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    8. Syntetos, Aris A. & Kholidasari, Inna & Naim, Mohamed M., 2016. "The effects of integrating management judgement into OUT levels: In or out of context?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 853-863.
    9. Hewage, Harsha Chamara & Perera, H. Niles & De Baets, Shari, 2022. "Forecast adjustments during post-promotional periods," European Journal of Operational Research, Elsevier, vol. 300(2), pages 461-472.
    10. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    11. Song, Haiyan & Gao, Bastian Z. & Lin, Vera S., 2013. "Combining statistical and judgmental forecasts via a web-based tourism demand forecasting system," International Journal of Forecasting, Elsevier, vol. 29(2), pages 295-310.
    12. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    13. De Baets, Shari & Harvey, Nigel, 2018. "Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support," International Journal of Forecasting, Elsevier, vol. 34(2), pages 163-180.
    14. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael, 2014. "Collaborative forecasting in the food supply chain: A conceptual framework," International Journal of Production Economics, Elsevier, vol. 158(C), pages 120-135.
    15. Asimakopoulos, Stavros & Dix, Alan, 2013. "Forecasting support systems technologies-in-practice: A model of adoption and use for product forecasting," International Journal of Forecasting, Elsevier, vol. 29(2), pages 322-336.
    16. Khosrowabadi, Naghmeh & Hoberg, Kai & Imdahl, Christina, 2022. "Evaluating human behaviour in response to AI recommendations for judgemental forecasting," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1151-1167.
    17. Franses, Philip Hans & Legerstee, Rianne, 2013. "Do statistical forecasting models for SKU-level data benefit from including past expert knowledge?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 80-87.
    18. A A Syntetos & J E Boylan & S M Disney, 2009. "Forecasting for inventory planning: a 50-year review," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 60(1), pages 149-160, May.
    19. Bert de Bruijn & Philip Hans Franses, 2012. "Managing Sales Forecasters," Tinbergen Institute Discussion Papers 12-131/III, Tinbergen Institute.
    20. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E. & Fildes, Robert & Goodwin, Paul, 2009. "The effects of integrating management judgement into intermittent demand forecasts," International Journal of Production Economics, Elsevier, vol. 118(1), pages 72-81, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:37:y:2021:i:2:p:1031-1046. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.