IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v205y2010i1p195-201.html
   My bibliography  Save this article

Do forecasts expressed as prediction intervals improve production planning decisions?

Author

Listed:
  • Goodwin, Paul
  • Önkal, Dilek
  • Thomson, Mary

Abstract

A number of studies have shown that providing point forecasts to decision makers can lead to improved production planning decisions. However, point forecasts do not convey information about the level of uncertainty that is associated with forecasts. In theory, the provision of prediction intervals, in addition to point forecasts, should therefore lead to further enhancements in decision quality. To test whether this is the case in practice, participants in an experiment were asked to decide on the production levels that were needed to meet the following week's demand for a series of products. Either underproduction cost twice as much per unit as overproduction or vice versa. The participants were supplied with either a point forecast, a 50% prediction interval, or a 95% prediction interval for the following week's demand. The prediction intervals did not improve the quality of the decisions and also reduced the propensity of the decision makers to respond appropriately to the asymmetry in the loss function. A simple heuristic is suggested to allow people to make more effective use of prediction intervals. It is found that applying this heuristic to 85% prediction intervals would lead to nearly optimal decisions.

Suggested Citation

  • Goodwin, Paul & Önkal, Dilek & Thomson, Mary, 2010. "Do forecasts expressed as prediction intervals improve production planning decisions?," European Journal of Operational Research, Elsevier, vol. 205(1), pages 195-201, August.
  • Handle: RePEc:eee:ejores:v:205:y:2010:i:1:p:195-201
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377-2217(09)00948-5
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Klassen, Robert D. & Flores, Benito E., 2001. "Forecasting practices of Canadian firms: Survey results and comparisons," International Journal of Production Economics, Elsevier, vol. 70(2), pages 163-174, March.
    2. Lawrence, Michael & Makridakis, Spyros, 1989. "Factors affecting judgmental forecasts and confidence intervals," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(2), pages 172-187, April.
    3. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    4. Herbert Moskowitz & Jeffrey G. Miller, 1975. "Information and Decision Systems for Production Planning," Management Science, INFORMS, vol. 22(3), pages 359-370, November.
    5. Anne B. Koehler & Rob J. Hyndman & Ralph D. Snyder & J. Keith Ord, 2005. "Prediction intervals for exponential smoothing using two new classes of state space models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(1), pages 17-37.
    6. Everette S. Gardner, Jr., 1988. "A Simple Method of Computing Prediction Intervals for Time Series Forecasts," Management Science, INFORMS, vol. 34(4), pages 541-546, April.
    7. Goodwin, Paul, 2005. "Providing support for decisions based on time series information under conditions of asymmetric loss," European Journal of Operational Research, Elsevier, vol. 163(2), pages 388-402, June.
    8. David F. Hendry & Neil R. Ericsson (ed.), 2003. "Understanding Economic Forecasts," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262582422, December.
    9. Wallis, Kenneth F., 2003. "Chi-squared tests of interval and density forecasts, and the Bank of England's fan charts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 165-175.
    10. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    11. Hua, Zhongsheng & Zhang, Bin, 2008. "Improving density forecast by modeling asymmetric features: An application to S&P500 returns," European Journal of Operational Research, Elsevier, vol. 185(2), pages 716-725, March.
    12. Dalrymple, Douglas J., 1987. "Sales forecasting practices: Results from a United States survey," International Journal of Forecasting, Elsevier, vol. 3(3-4), pages 379-391.
    13. Önkal, Dilek & Bolger, Fergus, 2004. "Provider-user differences in perceived usefulness of forecasting formats," Omega, Elsevier, vol. 32(1), pages 31-39, February.
    14. Granger, Clive W J, 1996. "Can We Improve the Perceived Quality of Economic Forecasts?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 455-473, Sept.-Oct.
    15. Landon, Joshua & Singpurwalla, Nozer D., 2008. "Choosing a Coverage Probability for Prediction Intervals," The American Statistician, American Statistical Association, vol. 62, pages 120-124, May.
    16. Remus, William, 1986. "Graduate students as surrogates for managers in experiments on business decision making," Journal of Business Research, Elsevier, vol. 14(1), pages 19-25, February.
    17. Fischhoff, Baruch, 1994. "What forecasts (seem to) mean," International Journal of Forecasting, Elsevier, vol. 10(3), pages 387-403, November.
    18. Lal, Mohan & Hassel, Lars, 1998. "The joint impact of environmental uncertainty and tolerance of ambiguity on top managers' perceptions of the usefulness of non-conventional management accounting information," Scandinavian Journal of Management, Elsevier, vol. 14(3), pages 259-271, March.
    19. Onkal, Dilek & Yates, J. Frank & Simga-Mugan, Can & Oztin, Sule, 2003. "Professional vs. amateur judgment accuracy: The case of foreign exchange rates," Organizational Behavior and Human Decision Processes, Elsevier, vol. 91(2), pages 169-185, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Phillips, Christina Jane & Nikolopoulos, Konstantinos, 2019. "Forecast quality improvement with Action Research: A success story at PharmaCo," International Journal of Forecasting, Elsevier, vol. 35(1), pages 129-143.
    2. Ma, Tiejun & Tang, Leilei & McGroarty, Frank & Sung, Ming-Chien & Johnson, Johnnie E. V, 2016. "Time is money: Costing the impact of duration misperception in market prices," European Journal of Operational Research, Elsevier, vol. 255(2), pages 397-410.
    3. Goodwin, Paul & Sinan Gönül, M. & Önkal, Dilek, 2013. "Antecedents and effects of trust in forecasting advice," International Journal of Forecasting, Elsevier, vol. 29(2), pages 354-366.
    4. Ma, T. & Fraser-Mackenzie, P.A.F. & Sung, M. & Kansara, A.P. & Johnson, J.E.V., 2022. "Are the least successful traders those most likely to exit the market? A survival analysis contribution to the efficient market debate," European Journal of Operational Research, Elsevier, vol. 299(1), pages 330-345.
    5. Green, Lawrence & Sung, Ming-Chien & Ma, Tiejun & Johnson, Johnnie E. V., 2019. "To what extent can new web-based technology improve forecasts? Assessing the economic value of information derived from Virtual Globes and its rate of diffusion in a financial market," European Journal of Operational Research, Elsevier, vol. 278(1), pages 226-239.
    6. Tavares Thomé, Antônio Márcio & Scavarda, Luiz Felipe & Fernandez, Nicole Suclla & Scavarda, Annibal José, 2012. "Sales and operations planning: A research synthesis," International Journal of Production Economics, Elsevier, vol. 138(1), pages 1-13.
    7. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    8. Peter Fraser‐Mackenzie & Ming‐Chien Sung & Johnnie E.V. Johnson, 2014. "Toward an Understanding of the Influence of Cultural Background and Domain Experience on the Effects of Risk‐Pricing Formats on Risk Perception," Risk Analysis, John Wiley & Sons, vol. 34(10), pages 1846-1869, October.
    9. Goodwin, Paul & Meeran, Sheik & Dyussekeneva, Karima, 2014. "The challenges of pre-launch forecasting of adoption time series for new durable products," International Journal of Forecasting, Elsevier, vol. 30(4), pages 1082-1097.
    10. Fuqiang Li & Shiying Zhang & Wenxuan Li & Wei Zhao & Bingkang Li & Huiru Zhao, 2019. "Forecasting Hourly Power Load Considering Time Division: A Hybrid Model Based on K-means Clustering and Probability Density Forecasting Techniques," Sustainability, MDPI, vol. 11(24), pages 1-17, December.
    11. Du, Ning & Budescu, David V. & Shelly, Marjorie K. & Omer, Thomas C., 2011. "The appeal of vague financial forecasts," Organizational Behavior and Human Decision Processes, Elsevier, vol. 114(2), pages 179-189, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    2. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    3. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    4. Goodwin, Paul & Fildes, Robert & Lawrence, Michael & Nikolopoulos, Konstantinos, 2007. "The process of using a forecasting support system," International Journal of Forecasting, Elsevier, vol. 23(3), pages 391-404.
    5. Belvedere, Valeria & Goodwin, Paul, 2017. "The influence of product involvement and emotion on short-term product demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(3), pages 652-661.
    6. Goodwin, Paul, 2005. "Providing support for decisions based on time series information under conditions of asymmetric loss," European Journal of Operational Research, Elsevier, vol. 163(2), pages 388-402, June.
    7. Fildes, Robert & Goodwin, Paul & Onkal, Dilek, 2015. "Information use in supply chain forecasting," MPRA Paper 66034, University Library of Munich, Germany.
    8. Ling He & Chenyi Hu, 2009. "Impacts of Interval Computing on Stock Market Variability Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 33(3), pages 263-276, April.
    9. Nowotarski, Jakub & Weron, Rafał, 2018. "Recent advances in electricity price forecasting: A review of probabilistic forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1548-1568.
    10. Duxbury, Darren, 2012. "Sunk costs and sunk benefits: A re-examination of re-investment decisions," The British Accounting Review, Elsevier, vol. 44(3), pages 144-156.
    11. Thomson, Mary E. & Pollock, Andrew C. & Gönül, M. Sinan & Önkal, Dilek, 2013. "Effects of trend strength and direction on performance and consistency in judgmental exchange rate forecasting," International Journal of Forecasting, Elsevier, vol. 29(2), pages 337-353.
    12. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    13. Stekler, H.O., 2007. "The future of macroeconomic forecasting: Understanding the forecasting process," International Journal of Forecasting, Elsevier, vol. 23(2), pages 237-248.
    14. Remus, William & O'Connor, Marcus & Griggs, Kenneth, 1998. "The impact of information of unknown correctness on the judgmental forecasting process," International Journal of Forecasting, Elsevier, vol. 14(3), pages 313-322, September.
    15. Welch, Eric & Bretschneider, Stuart & Rohrbaugh, John, 1998. "Accuracy of judgmental extrapolation of time series data: Characteristics, causes, and remediation strategies for forecasting," International Journal of Forecasting, Elsevier, vol. 14(1), pages 95-110, March.
    16. Sagaert, Yves R. & Aghezzaf, El-Houssaine & Kourentzes, Nikolaos & Desmet, Bram, 2018. "Tactical sales forecasting using a very large set of macroeconomic indicators," European Journal of Operational Research, Elsevier, vol. 264(2), pages 558-569.
    17. Yelland, Phillip M., 2010. "Bayesian forecasting of parts demand," International Journal of Forecasting, Elsevier, vol. 26(2), pages 374-396, April.
    18. Hansen, Bruce E., 2006. "Interval forecasts and parameter uncertainty," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 377-398.
    19. Lorenz Graf-Vlachy, 2019. "Like student like manager? Using student subjects in managerial debiasing research," Review of Managerial Science, Springer, vol. 13(2), pages 347-376, April.
    20. Song, Haiyan & Gao, Bastian Z. & Lin, Vera S., 2013. "Combining statistical and judgmental forecasts via a web-based tourism demand forecasting system," International Journal of Forecasting, Elsevier, vol. 29(2), pages 295-310.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:205:y:2010:i:1:p:195-201. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.