IDEAS home Printed from https://ideas.repec.org/a/spr/eurjdp/v6y2018i1d10.1007_s40070-017-0063-2.html
   My bibliography  Save this article

Predicting in shock: on the impact of negative, extreme, rare, and short lived events on judgmental forecasts

Author

Listed:
  • Ian Durbach

    (University of Cape Town
    African Institute for Mathematical Sciences)

  • Gilberto Montibeller

    (Loughborough University)

Abstract

The occurrence of unexpected events that are extreme in magnitude, rare in frequency, and short-lived in duration poses distinctive challenges to decision makers and planners. In this paper we examine the impact of negative versions of these events, which we term “shocks”, on the judgmental forecasts of subjects experiencing them. A behavioral experiment asking participants to forecast monthly time series in the presence of temporary but extreme decreases in those series is used. Average changes to annual prediction intervals and 1-month ahead forecasts were much smaller than the magnitude of the shock and occurred in proportion to the size of the shock. Changes to prediction intervals were more persistent for moderate than large shocks, and larger for shocks occurring a second time. Our results provide supporting evidence for the view that decision makers underweight rare and extreme events rather than overweight them, consistent with a discounting or forgetting effect. The behavioral findings are relevant to operations researchers involved in expert judgment elicitation and in supporting decision making.

Suggested Citation

  • Ian Durbach & Gilberto Montibeller, 2018. "Predicting in shock: on the impact of negative, extreme, rare, and short lived events on judgmental forecasts," EURO Journal on Decision Processes, Springer;EURO - The Association of European Operational Research Societies, vol. 6(1), pages 213-233, June.
  • Handle: RePEc:spr:eurjdp:v:6:y:2018:i:1:d:10.1007_s40070-017-0063-2
    DOI: 10.1007/s40070-017-0063-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s40070-017-0063-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s40070-017-0063-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Goodwin, Paul & Wright, George, 1993. "Improving judgmental time series forecasting: A review of the guidance provided by research," International Journal of Forecasting, Elsevier, vol. 9(2), pages 147-161, August.
    2. Eggleton, Irc, 1982. "Intuitive Time-Series Extrapolation," Journal of Accounting Research, Wiley Blackwell, vol. 20(1), pages 68-102.
    3. Lawrence, Michael & Makridakis, Spyros, 1989. "Factors affecting judgmental forecasts and confidence intervals," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(2), pages 172-187, April.
    4. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    5. Tversky, Amos & Kahneman, Daniel, 1992. "Advances in Prospect Theory: Cumulative Representation of Uncertainty," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 297-323, October.
    6. Goodwin, Paul & Sinan Gönül, M. & Önkal, Dilek, 2013. "Antecedents and effects of trust in forecasting advice," International Journal of Forecasting, Elsevier, vol. 29(2), pages 354-366.
    7. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    8. Aric Shafran, 2011. "Self-protection against repeated low probability risks," Journal of Risk and Uncertainty, Springer, vol. 42(3), pages 263-285, June.
    9. Du, Ning & Budescu, David V., 2007. "Does past volatility affect investors' price forecasts and confidence judgements?," International Journal of Forecasting, Elsevier, vol. 23(3), pages 497-511.
    10. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    11. Otwin Becker & Johannes Leitner & Ulrike Leopold-Wildburger, 2009. "Expectation formation and regime switches," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 350-364, September.
    12. Carolyn Kousky, 2010. "Learning from Extreme Events: Risk Perceptions after the Flood," Land Economics, University of Wisconsin Press, vol. 86(3).
    13. Hämäläinen, Raimo P. & Luoma, Jukka & Saarinen, Esa, 2013. "On the importance of behavioral operational research: The case of understanding and communicating about dynamic systems," European Journal of Operational Research, Elsevier, vol. 228(3), pages 623-634.
    14. Manel Baucells & Martin Weber & Frank Welfens, 2011. "Reference-Point Formation and Updating," Management Science, INFORMS, vol. 57(3), pages 506-519, March.
    15. O'Connor, Marcus & Remus, William & Griggs, Ken, 1993. "Judgemental forecasting in times of change," International Journal of Forecasting, Elsevier, vol. 9(2), pages 163-172, August.
    16. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    17. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    18. Robert Meyer, 2012. "Failing to learn from experience about catastrophes: The case of hurricane preparedness," Journal of Risk and Uncertainty, Springer, vol. 45(1), pages 25-50, August.
    19. Lawrence, Michael J. & Edmundson, Robert H. & O'Connor, Marcus J., 1985. "An examination of the accuracy of judgmental extrapolation of time series," International Journal of Forecasting, Elsevier, vol. 1(1), pages 25-35.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Dongdong & Li, Chunjiao & Goh, Hui Hwang & Ahmad, Tanveer & Zhu, Hongyu & Liu, Hui & Wu, Thomas, 2022. "A comprehensive overview of modeling approaches and optimal control strategies for cyber-physical resilience in power systems," Renewable Energy, Elsevier, vol. 189(C), pages 1383-1406.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    2. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    3. Han, Weiwei & Wang, Xun & Petropoulos, Fotios & Wang, Jing, 2019. "Brain imaging and forecasting: Insights from judgmental model selection," Omega, Elsevier, vol. 87(C), pages 1-9.
    4. De Baets, Shari & Harvey, Nigel, 2020. "Using judgment to select and adjust forecasts from statistical models," European Journal of Operational Research, Elsevier, vol. 284(3), pages 882-895.
    5. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    6. Petropoulos, Fotios & Goodwin, Paul & Fildes, Robert, 2017. "Using a rolling training approach to improve judgmental extrapolations elicited from forecasters with technical knowledge," International Journal of Forecasting, Elsevier, vol. 33(1), pages 314-324.
    7. Thomson, Mary E. & Pollock, Andrew C. & Gönül, M. Sinan & Önkal, Dilek, 2013. "Effects of trend strength and direction on performance and consistency in judgmental exchange rate forecasting," International Journal of Forecasting, Elsevier, vol. 29(2), pages 337-353.
    8. Theocharis, Zoe & Harvey, Nigel, 2016. "Order effects in judgmental forecasting," International Journal of Forecasting, Elsevier, vol. 32(1), pages 44-60.
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Lin, Vera Shanshan & Goodwin, Paul & Song, Haiyan, 2014. "Accuracy and bias of experts’ adjusted forecasts," Annals of Tourism Research, Elsevier, vol. 48(C), pages 156-174.
    11. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    12. Fildes, Robert & Goodwin, Paul & Onkal, Dilek, 2015. "Information use in supply chain forecasting," MPRA Paper 66034, University Library of Munich, Germany.
    13. Blanc, Sebastian M. & Setzer, Thomas, 2015. "Analytical debiasing of corporate cash flow forecasts," European Journal of Operational Research, Elsevier, vol. 243(3), pages 1004-1015.
    14. Gerda Ana Melnik-Leroy & Gintautas Dzemyda, 2021. "How to Influence the Results of MCDM?—Evidence of the Impact of Cognitive Biases," Mathematics, MDPI, vol. 9(2), pages 1-25, January.
    15. Makridakis, Spyros & Hyndman, Rob J. & Petropoulos, Fotios, 2020. "Forecasting in social settings: The state of the art," International Journal of Forecasting, Elsevier, vol. 36(1), pages 15-28.
    16. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    17. Brent Moritz & Enno Siemsen & Mirko Kremer, 2014. "Judgmental Forecasting: Cognitive Reflection and Decision Speed," Production and Operations Management, Production and Operations Management Society, vol. 23(7), pages 1146-1160, July.
    18. Reimers, Stian & Harvey, Nigel, 2011. "Sensitivity to autocorrelation in judgmental time series forecasting," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1196-1214, October.
    19. Katsagounos, Ilias & Thomakos, Dimitrios D. & Litsiou, Konstantia & Nikolopoulos, Konstantinos, 2021. "Superforecasting reality check: Evidence from a small pool of experts and expedited identification," European Journal of Operational Research, Elsevier, vol. 289(1), pages 107-117.
    20. Andrew Royal, 2017. "Dynamics in risk taking with a low-probability hazard," Journal of Risk and Uncertainty, Springer, vol. 55(1), pages 41-69, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:eurjdp:v:6:y:2018:i:1:d:10.1007_s40070-017-0063-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.