IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v34y2018i2p163-180.html
   My bibliography  Save this article

Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support

Author

Listed:
  • De Baets, Shari
  • Harvey, Nigel

Abstract

How effective are different approaches for the provision of forecasting support? Forecasts may be either unaided or made with the help of statistical forecasts. In practice, the latter are often crude forecasts that do not take sporadic perturbations into account. Most research considers forecasts based on series that have been cleansed of perturbation effects. This paper considers an experiment in which people made forecasts from time series that were disturbed by promotions. In all conditions, under-forecasting occurred during promotional periods and over-forecasting during normal ones. The relative sizes of these effects depended on the proportions of periods in the data series that contained promotions. The statistical forecasts improved the forecasting accuracy, not because they reduced these biases, but because they decreased the random error (scatter). The performance improvement did not depend on whether the forecasts were based on cleansed series. Thus, the effort invested in producing cleansed time series from which to forecast may not be warranted: companies may benefit from giving their forecasters even crude statistical forecasts. In a second experiment, forecasters received optimal statistical forecasts that took the effects of promotions into account fully. This increased the accuracy because the biases were almost eliminated and the random error was reduced by 20%. Thus, the additional effort required to produce forecasts that take promotional effects into account is worthwhile.

Suggested Citation

  • De Baets, Shari & Harvey, Nigel, 2018. "Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support," International Journal of Forecasting, Elsevier, vol. 34(2), pages 163-180.
  • Handle: RePEc:eee:intfor:v:34:y:2018:i:2:p:163-180
    DOI: 10.1016/j.ijforecast.2017.09.007
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207017301048
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ijforecast.2017.09.007?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nada R. Sanders & Karl B. Manrodt, 1994. "Forecasting Practices in US Corporations: Survey Results," Interfaces, INFORMS, vol. 24(2), pages 92-100, April.
    2. Sanders, Nada R. & Manrodt, Karl B., 2003. "The efficacy of using judgmental versus quantitative forecasting methods in practice," Omega, Elsevier, vol. 31(6), pages 511-522, December.
    3. Bovi, Maurizio, 2009. "Economic versus psychological forecasting. Evidence from consumer confidence surveys," Journal of Economic Psychology, Elsevier, vol. 30(4), pages 563-574, August.
    4. Kottemann, Jeffrey E. & Davis, Fred D. & Remus, William E., 1994. "Computer-Assisted Decision Making: Performance, Beliefs, and the Illusion of Control," Organizational Behavior and Human Decision Processes, Elsevier, vol. 57(1), pages 26-37, January.
    5. Goodwin, Paul & Fildes, Robert & Lawrence, Michael & Nikolopoulos, Konstantinos, 2007. "The process of using a forecasting support system," International Journal of Forecasting, Elsevier, vol. 23(3), pages 391-404.
    6. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    7. Harvey, Nigel, 1995. "Why Are Judgments Less Consistent in Less Predictable Task Situations?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 63(3), pages 247-263, September.
    8. Goodwin, Paul & Fildes, Robert & Lawrence, Michael & Stephens, Greg, 2011. "Restrictiveness and guidance in support systems," Omega, Elsevier, vol. 39(3), pages 242-253, June.
    9. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    10. Rodolphe Durand, 2003. "Predicting a firm's forecasting ability: the roles of organizational illusion of control and organizational attention," Strategic Management Journal, Wiley Blackwell, vol. 24(9), pages 821-838, September.
    11. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E., 2010. "Judging the judges through accuracy-implication metrics: The case of inventory forecasting," International Journal of Forecasting, Elsevier, vol. 26(1), pages 134-143, January.
    12. Goodwin, Paul, 2000. "Improving the voluntary integration of statistical forecasts and judgment," International Journal of Forecasting, Elsevier, vol. 16(1), pages 85-99.
    13. Lawrence, Michael, 2000. "What does it take to achieve adoption in sales forecasting?," International Journal of Forecasting, Elsevier, vol. 16(2), pages 147-148.
    14. Theocharis, Zoe & Harvey, Nigel, 2016. "Order effects in judgmental forecasting," International Journal of Forecasting, Elsevier, vol. 32(1), pages 44-60.
    15. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    16. Robert Fildes & Paul Goodwin, 2007. "Against Your Better Judgment? How Organizations Can Improve Their Use of Management Judgment in Forecasting," Interfaces, INFORMS, vol. 37(6), pages 570-576, December.
    17. Webby, Richard & O'Connor, Marcus & Edmundson, Bob, 2005. "Forecasting support systems for the incorporation of event information: An empirical investigation," International Journal of Forecasting, Elsevier, vol. 21(3), pages 411-423.
    18. Kourentzes, Nikolaos & Petropoulos, Fotios, 2016. "Forecasting with multivariate temporal aggregation: The case of promotional modelling," International Journal of Production Economics, Elsevier, vol. 181(PA), pages 145-153.
    19. Lim, Joa Sang & O'Connor, Marcus, 1996. "Judgmental forecasting with time series and causal information," International Journal of Forecasting, Elsevier, vol. 12(1), pages 139-153, March.
    20. Trapero, Juan R. & Pedregal, Diego J. & Fildes, R. & Kourentzes, N., 2013. "Analysis of judgmental adjustments in the presence of promotions," International Journal of Forecasting, Elsevier, vol. 29(2), pages 234-243.
    21. Reimers, Stian & Harvey, Nigel, 2011. "Sensitivity to autocorrelation in judgmental time series forecasting," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1196-1214, October.
    22. Lawrence, Michael & O'Connor, Marcus, 1992. "Exploring judgemental forecasting," International Journal of Forecasting, Elsevier, vol. 8(1), pages 15-26, June.
    23. Huang, Tao & Fildes, Robert & Soopramanien, Didier, 2014. "The value of competitive information in forecasting FMCG retail product sales and the variable selection problem," European Journal of Operational Research, Elsevier, vol. 237(2), pages 738-748.
    24. Önkal, Dilek & Zeynep Sayım, K. & Lawrence, Michael, 2012. "Wisdom of group forecasts: Does role-playing play a role?," Omega, Elsevier, vol. 40(6), pages 693-702.
    25. Hilary, Gilles & Hsu, Charles, 2011. "Endogenous overconfidence in managerial forecasts," Journal of Accounting and Economics, Elsevier, vol. 51(3), pages 300-313, April.
    26. Harvey, Nigel & Harries, Clare, 2004. "Effects of judges' forecasting on their later combination of forecasts for the same outcomes," International Journal of Forecasting, Elsevier, vol. 20(3), pages 391-409.
    27. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E. & Fildes, Robert & Goodwin, Paul, 2009. "The effects of integrating management judgement into intermittent demand forecasts," International Journal of Production Economics, Elsevier, vol. 118(1), pages 72-81, March.
    28. Yates, J. Frank & McDaniel, Linda S. & Brown, Eric S., 1991. "Probabilistic forecasts of stock prices and earnings: The hazards of nascent expertise," Organizational Behavior and Human Decision Processes, Elsevier, vol. 49(1), pages 60-79, June.
    29. Robert Libby & Kristina Rennekamp, 2012. "Self‐Serving Attribution Bias, Overconfidence, and the Issuance of Management Forecasts," Journal of Accounting Research, Wiley Blackwell, vol. 50(1), pages 197-231, March.
    30. Robert Fildes & Fotios Petropoulos, 2015. "Improving Forecast Quality in Practice," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 36, pages 5-12, Winter.
    31. Franses, Philip Hans & Legerstee, Rianne, 2009. "Properties of expert adjustments on model-based SKU-level forecasts," International Journal of Forecasting, Elsevier, vol. 25(1), pages 35-47.
    32. Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
    33. Rodolphe Durand, 2003. "Predicting a firm's forecasting ability: The roles of organizational illusion of control and organizational attention," Post-Print hal-00480860, HAL.
    34. Paul Goodwin, 2010. "The Holt-Winters Approach to Exponential Smoothing: 50 Years Old and Going Strong," Foresight: The International Journal of Applied Forecasting, International Institute of Forecasters, issue 19, pages 30-33, Fall.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hewage, Harsha Chamara & Perera, H. Niles & De Baets, Shari, 2022. "Forecast adjustments during post-promotional periods," European Journal of Operational Research, Elsevier, vol. 300(2), pages 461-472.
    2. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    3. Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
    4. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    5. Khosrowabadi, Naghmeh & Hoberg, Kai & Imdahl, Christina, 2022. "Evaluating human behaviour in response to AI recommendations for judgemental forecasting," European Journal of Operational Research, Elsevier, vol. 303(3), pages 1151-1167.
    6. Fildes, Robert & Goodwin, Paul & Önkal, Dilek, 2019. "Use and misuse of information in supply chain forecasting of promotion effects," International Journal of Forecasting, Elsevier, vol. 35(1), pages 144-156.
    7. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    8. Fildes, Robert & Goodwin, Paul, 2021. "Stability in the inefficient use of forecasting systems: A case study in a supply chain company," International Journal of Forecasting, Elsevier, vol. 37(2), pages 1031-1046.
    9. Zuzana Rowland & George Lazaroiu & Ivana Podhorská, 2020. "Use of Neural Networks to Accommodate Seasonal Fluctuations When Equalizing Time Series for the CZK/RMB Exchange Rate," Risks, MDPI, vol. 9(1), pages 1-21, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    4. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    5. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    6. Hewage, Harsha Chamara & Perera, H. Niles & De Baets, Shari, 2022. "Forecast adjustments during post-promotional periods," European Journal of Operational Research, Elsevier, vol. 300(2), pages 461-472.
    7. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    8. Alvarado-Valencia, Jorge & Barrero, Lope H. & Önkal, Dilek & Dennerlein, Jack T., 2017. "Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(1), pages 298-313.
    9. Song, Haiyan & Gao, Bastian Z. & Lin, Vera S., 2013. "Combining statistical and judgmental forecasts via a web-based tourism demand forecasting system," International Journal of Forecasting, Elsevier, vol. 29(2), pages 295-310.
    10. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    11. Syntetos, Aris A. & Kholidasari, Inna & Naim, Mohamed M., 2016. "The effects of integrating management judgement into OUT levels: In or out of context?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 853-863.
    12. Sroginis, Anna & Fildes, Robert & Kourentzes, Nikolaos, 2023. "Use of contextual and model-based information in adjusting promotional forecasts," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1177-1191.
    13. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    14. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    15. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    16. Fildes, Robert & Ma, Shaohui & Kolassa, Stephan, 2022. "Retail forecasting: Research and practice," International Journal of Forecasting, Elsevier, vol. 38(4), pages 1283-1318.
    17. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael, 2014. "Collaborative forecasting in the food supply chain: A conceptual framework," International Journal of Production Economics, Elsevier, vol. 158(C), pages 120-135.
    18. F Caniato & M Kalchschmidt & S Ronchi, 2011. "Integrating quantitative and qualitative forecasting approaches: organizational learning in an action research case," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 413-424, March.
    19. Pennings, Clint L.P. & van Dalen, Jan & Rook, Laurens, 2019. "Coordinating judgmental forecasting: Coping with intentional biases," Omega, Elsevier, vol. 87(C), pages 46-56.
    20. Bert de Bruijn & Philip Hans Franses, 2012. "Managing Sales Forecasters," Tinbergen Institute Discussion Papers 12-131/III, Tinbergen Institute.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:34:y:2018:i:2:p:163-180. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.