IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v213y2011i3p459-469.html
   My bibliography  Save this article

Experiments on forecasting behavior with several sources of information - A review of the literature

Author

Listed:
  • Leitner, Johannes
  • Leopold-Wildburger, Ulrike

Abstract

Decision makers frequently have to forecast the future values of a time series (e.g. the price of a commodity, sales figures) given several sources of information (e.g. leading indicators, forecasts of advisors). As a subdomain of decision theory the explanation and the improvement of human forecasting behavior are interdisciplinary issues and have been subject to extensive empirical field and laboratory research. We here review the relevant experimental literature, demonstrate the significance of these results for decision science in general, and summarize the implications for practical forecasting applications.

Suggested Citation

  • Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
  • Handle: RePEc:eee:ejores:v:213:y:2011:i:3:p:459-469
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221711000099
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lawrence, Michael & O'Connor, Marcus, 1992. "Exploring judgemental forecasting," International Journal of Forecasting, Elsevier, vol. 8(1), pages 15-26, June.
    2. Willemain, Thomas R., 1989. "Graphical adjustment of statistical forecasts," International Journal of Forecasting, Elsevier, vol. 5(2), pages 179-185.
    3. Bunn, Derek W., 1996. "Non-traditional methods of forecasting," European Journal of Operational Research, Elsevier, vol. 92(3), pages 528-536, August.
    4. Derek Bunn & George Wright, 1991. "Interaction of Judgemental and Statistical Forecasting Methods: Issues & Analysis," Management Science, INFORMS, vol. 37(5), pages 501-518, May.
    5. Everette S. Gardner, Jr. & Ed. Mckenzie, 1985. "Forecasting Trends in Time Series," Management Science, INFORMS, vol. 31(10), pages 1237-1246, October.
    6. Willemain, Thomas R., 1991. "The effect of graphical adjustment on forecast accuracy," International Journal of Forecasting, Elsevier, vol. 7(2), pages 151-154, August.
    7. Dwyer, Gerald P, Jr, et al, 1993. "Tests of Rational Expectations in a Stark Setting," Economic Journal, Royal Economic Society, vol. 103(418), pages 586-601, May.
    8. Tietje, Olaf, 2005. "Identification of a small reliable and efficient set of consistent scenarios," European Journal of Operational Research, Elsevier, vol. 162(2), pages 418-432, April.
    9. Otwin Becker & Johannes Leitner & Ulrike Leopold-Wildburger, 2008. "Modeling Expectation Formation Involving Several Sources of Information," German Economic Review, Verein für Socialpolitik, vol. 9, pages 96-112, February.
    10. Klassen, Robert D. & Flores, Benito E., 2001. "Forecasting practices of Canadian firms: Survey results and comparisons," International Journal of Production Economics, Elsevier, vol. 70(2), pages 163-174, March.
    11. Wright, George & Cairns, George & Goodwin, Paul, 2009. "Teaching scenario planning: Lessons from practice in academe and business," European Journal of Operational Research, Elsevier, vol. 194(1), pages 323-335, April.
    12. Goodwin, Paul & Wright, George, 1993. "Improving judgmental time series forecasting: A review of the guidance provided by research," International Journal of Forecasting, Elsevier, vol. 9(2), pages 147-161, August.
    13. Maines, Laureen A., 1996. "An experimental examination of subjective forecast combination," International Journal of Forecasting, Elsevier, vol. 12(2), pages 223-233, June.
    14. Goodwin, Paul, 2000. "Correct or combine? Mechanically integrating judgmental forecasts with statistical methods," International Journal of Forecasting, Elsevier, vol. 16(2), pages 261-275.
    15. Smith, Vernon L, 1982. "Microeconomic Systems as an Experimental Science," American Economic Review, American Economic Association, vol. 72(5), pages 923-955, December.
    16. Goodwin, Paul & Önkal, Dilek & Thomson, Mary, 2010. "Do forecasts expressed as prediction intervals improve production planning decisions?," European Journal of Operational Research, Elsevier, vol. 205(1), pages 195-201, August.
    17. Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
    18. Lawrence, Michael & Makridakis, Spyros, 1989. "Factors affecting judgmental forecasts and confidence intervals," Organizational Behavior and Human Decision Processes, Elsevier, vol. 43(2), pages 172-187, April.
    19. Donna F. Davis & John T. Mentzer & Teresa M. Mccarthy & Susan L. Golicic, 2006. "The evolution of sales forecasting management: a 20-year longitudinal study of forecasting practices," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(5), pages 303-324.
    20. Fischer, Ilan & Harvey, Nigel, 1999. "Combining forecasts: What information do judges need to outperform the simple average?," International Journal of Forecasting, Elsevier, vol. 15(3), pages 227-246, July.
    21. Sanders, Nada R. & Manrodt, Karl B., 2003. "The efficacy of using judgmental versus quantitative forecasting methods in practice," Omega, Elsevier, vol. 31(6), pages 511-522, December.
    22. Harvey, Nigel & Harries, Clare, 2004. "Effects of judges' forecasting on their later combination of forecasts for the same outcomes," International Journal of Forecasting, Elsevier, vol. 20(3), pages 391-409.
    23. Flores, Benito E. & Olson, David L. & Wolfe, Christopher, 1992. "Judgmental adjustment of forecasts: A comparison of methods," International Journal of Forecasting, Elsevier, vol. 7(4), pages 421-433, March.
    24. Fildes, Robert & Stekler, Herman, 2002. "The state of macroeconomic forecasting," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 435-468, December.
    25. Blomqvist, Hans C., 1989. "The `rationality' of expectations: An experimental approach," Journal of Economic Psychology, Elsevier, vol. 10(2), pages 275-299, June.
    26. Vernon L. Smith, 1962. "An Experimental Study of Competitive Market Behavior," Journal of Political Economy, University of Chicago Press, vol. 70, pages 111-111.
    27. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E. & Fildes, Robert & Goodwin, Paul, 2009. "The effects of integrating management judgement into intermittent demand forecasts," International Journal of Production Economics, Elsevier, vol. 118(1), pages 72-81, March.
    28. O'Connor, Marcus & Remus, William & Griggs, Ken, 1993. "Judgemental forecasting in times of change," International Journal of Forecasting, Elsevier, vol. 9(2), pages 163-172, August.
    29. Harvey, Nigel & Harries, Clare & Fischer, Ilan, 2000. "Using Advice and Assessing Its Quality," Organizational Behavior and Human Decision Processes, Elsevier, vol. 81(2), pages 252-273, March.
    30. Webby, Richard & O'Connor, Marcus, 1996. "Judgemental and statistical time series forecasting: a review of the literature," International Journal of Forecasting, Elsevier, vol. 12(1), pages 91-118, March.
    31. Dalrymple, Douglas J., 1975. "Sales forecasting methods and accuracy," Business Horizons, Elsevier, vol. 18(6), pages 69-73, December.
    32. Fildes, Robert & Stekler, Herman, 2002. "Reply to the comments on 'The state of macroeconomic forecasting'," Journal of Macroeconomics, Elsevier, vol. 24(4), pages 503-505, December.
    33. Sanders, NR, 1992. "Accuracy of judgmental forecasts: A comparison," Omega, Elsevier, vol. 20(3), pages 353-364, May.
    34. Becker, Otwin & Leitner, Johannes & Leopold-Wildburger, Ulrike, 2007. "Heuristic modeling of expectation formation in a complex experimental information environment," European Journal of Operational Research, Elsevier, vol. 176(2), pages 975-985, January.
    35. Goodwin, Paul & Fildes, Robert & Lawrence, Michael & Nikolopoulos, Konstantinos, 2007. "The process of using a forecasting support system," International Journal of Forecasting, Elsevier, vol. 23(3), pages 391-404.
    36. Schmalensee, Richard, 1976. "An Experimental Study of Expectation Formation," Econometrica, Econometric Society, vol. 44(1), pages 17-41, January.
    37. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    38. Goodwin, Paul, 2005. "Providing support for decisions based on time series information under conditions of asymmetric loss," European Journal of Operational Research, Elsevier, vol. 163(2), pages 388-402, June.
    39. M. J. Lawrence & R. H. Edmundson & M. J. O'Connor, 1986. "The Accuracy of Combining Judgemental and Statistical Forecasts," Management Science, INFORMS, vol. 32(12), pages 1521-1532, December.
    40. Robin M. Hogarth & Spyros Makridakis, 1981. "Forecasting and Planning: An Evaluation," Management Science, INFORMS, vol. 27(2), pages 115-138, February.
    41. Beckman, Steven R. & Downs, David, 1997. "Forecasters as imperfect information processors: Experimental and survey evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 32(1), pages 89-100, January.
    42. Hey, John D., 1994. "Expectations formation: Rational or adaptive or ...?," Journal of Economic Behavior & Organization, Elsevier, vol. 25(3), pages 329-349, December.
    43. Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
    44. Taylor, Mark P. & Allen, Helen, 1992. "The use of technical analysis in the foreign exchange market," Journal of International Money and Finance, Elsevier, vol. 11(3), pages 304-314, June.
    45. Peterson, Steven P. & Reilly, Robert J., 1991. "The rationality of expectations: the blomqvist experiment reconsidered," Journal of Economic Psychology, Elsevier, vol. 12(3), pages 527-533, September.
    46. Bernd Brandl & Christian Keber & Matthias Schuster, 2006. "An automated econometric decision support system: forecasts for foreign exchange trades," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 14(4), pages 401-415, December.
    47. Cars Hommes & Joep Sonnemans & Jan Tuinstra & Henk van de Velden, 2005. "Coordination of Expectations in Asset Pricing Experiments," Review of Financial Studies, Society for Financial Studies, vol. 18(3), pages 955-980.
    48. Lawrence, Michael & O'Connor, Marcus & Edmundson, Bob, 2000. "A field study of sales forecasting accuracy and processes," European Journal of Operational Research, Elsevier, vol. 122(1), pages 151-160, April.
    49. Goodwin, Paul, 2000. "Improving the voluntary integration of statistical forecasts and judgment," International Journal of Forecasting, Elsevier, vol. 16(1), pages 85-99.
    50. Bunn, Derek W. & Salo, Ahti A., 1993. "Forecasting with scenarios," European Journal of Operational Research, Elsevier, vol. 68(3), pages 291-303, August.
    51. Nerlove, Marc & Grether, David M. & Carvalho, José L., 1979. "Analysis of Economic Time Series," Elsevier Monographs, Elsevier, edition 1, number 9780125157506 edited by Shell, Karl.
    52. Johannes Leitner & Robert Schmidt, 2007. "Expectation formation in an experimental foreign exchange market," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 15(2), pages 167-184, June.
    53. Stephen J. DeCanio, 1979. "Rational Expectations and Learning from Experience," The Quarterly Journal of Economics, Oxford University Press, vol. 93(1), pages 47-57.
    54. Plott, Charles R, 1982. "Industrial Organization Theory and Experimental Economics," Journal of Economic Literature, American Economic Association, vol. 20(4), pages 1485-1527, December.
    55. Johannes Leitner & Robert Schmidt, 2006. "A systematic comparison of professional exchange rate forecasts with the judgemental forecasts of novices," Central European Journal of Operations Research, Springer;Slovak Society for Operations Research;Hungarian Operational Research Society;Czech Society for Operations Research;Österr. Gesellschaft für Operations Research (ÖGOR);Slovenian Society Informatika - Section for Operational Research;Croatian Operational Research Society, vol. 14(1), pages 87-102, February.
    56. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    57. Lawrence, Michael J. & Edmundson, Robert H. & O'Connor, Marcus J., 1985. "An examination of the accuracy of judgmental extrapolation of time series," International Journal of Forecasting, Elsevier, vol. 1(1), pages 25-35.
    58. Otwin Becker & Johannes Leitner & Ulrike Leopold-Wildburger, 2009. "Expectation formation and regime switches," Experimental Economics, Springer;Economic Science Association, vol. 12(3), pages 350-364, September.
    59. Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
    60. Roth, Alvin E, 1988. "Laboratory Experimentation in Economics: A Methodological Overview," Economic Journal, Royal Economic Society, vol. 98(393), pages 974-1031, December.
    61. Lim, Joa Sang & O'Connor, Marcus, 1996. "Judgmental forecasting with time series and causal information," International Journal of Forecasting, Elsevier, vol. 12(1), pages 139-153, March.
    62. Dalrymple, Douglas J., 1987. "Sales forecasting practices: Results from a United States survey," International Journal of Forecasting, Elsevier, vol. 3(3-4), pages 379-391.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Meub, Lukas & Proeger, Till & Bizer, Kilian, 2013. "Anchoring: A valid explanation for biased forecasts when rational predictions are easily accessible and well incentivized?," Center for European, Governance and Economic Development Research Discussion Papers 166, University of Goettingen, Department of Economics.
    2. Fildes, Robert & Goodwin, Paul & Onkal, Dilek, 2015. "Information use in supply chain forecasting," MPRA Paper 66034, University Library of Munich, Germany.
    3. Blanc, Sebastian M. & Setzer, Thomas, 2015. "Analytical debiasing of corporate cash flow forecasts," European Journal of Operational Research, Elsevier, vol. 243(3), pages 1004-1015.
    4. repec:eee:ejores:v:264:y:2018:i:2:p:558-569 is not listed on IDEAS
    5. Syntetos, Aris A. & Kholidasari, Inna & Naim, Mohamed M., 2016. "The effects of integrating management judgement into OUT levels: In or out of context?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 853-863.
    6. repec:spr:scient:v:91:y:2012:i:1:d:10.1007_s11192-011-0572-x is not listed on IDEAS
    7. Petropoulos, Fotios & Fildes, Robert & Goodwin, Paul, 2016. "Do ‘big losses’ in judgmental adjustments to statistical forecasts affect experts’ behaviour?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 842-852.
    8. Meub, Lukas & Proeger, Till & Bizer, Kilian & Spiwoks, Markus, 2015. "Strategic coordination in forecasting – An experimental study," Finance Research Letters, Elsevier, vol. 13(C), pages 155-162.
    9. Bizer, Kilian & Meub, Lukas & Proeger, Till & Spiwoks, Markus, 2014. "Strategic coordination in forecasting: An experimental study," Center for European, Governance and Economic Development Research Discussion Papers 195, University of Goettingen, Department of Economics.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:213:y:2011:i:3:p:459-469. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/locate/eor .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.