Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning
AbstractDemand forecasting is a crucial aspect of the planning process in supply-chain companies. The most common approach to forecasting demand in these companies involves the use of a computerized forecasting system to produce initial forecasts and the subsequent judgmental adjustment of these forecasts by the company's demand planners, ostensibly to take into account exceptional circumstances expected over the planning horizon. Making these adjustments can involve considerable management effort and time, but do they improve accuracy, and are some types of adjustment more effective than others? To investigate this, we collected data on more than 60,000 forecasts and outcomes from four supply-chain companies. In three of the companies, on average, judgmental adjustments increased accuracy. However, a detailed analysis revealed that, while the relatively larger adjustments tended to lead to greater average improvements in accuracy, the smaller adjustments often damaged accuracy. In addition, positive adjustments, which involved adjusting the forecast upwards, were much less likely to improve accuracy than negative adjustments. They were also made in the wrong direction more frequently, suggesting a general bias towards optimism. Models were then developed to eradicate such biases. Based on both this statistical analysis and organisational observation, the paper goes on to analyse strategies designed to enhance the effectiveness of judgmental adjustments directly.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal International Journal of Forecasting.
Volume (Year): 25 (2009)
Issue (Month): 1 ()
Contact details of provider:
Web page: http://www.elsevier.com/locate/ijforecast
Forecasting accuracy Judgment Heuristics and biases Supply chain Forecasting support systems Practice Combining Forecast adjustment;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Kottemann, Jeffrey E. & Davis, Fred D. & Remus, William E., 1994. "Computer-Assisted Decision Making: Performance, Beliefs, and the Illusion of Control," Organizational Behavior and Human Decision Processes, Elsevier, vol. 57(1), pages 26-37, January.
- Deschamps, Elaine, 2004. "The impact of institutional change on forecast accuracy: A case study of budget forecasting in Washington State," International Journal of Forecasting, Elsevier, vol. 20(4), pages 647-657.
- Harvey, Nigel, 1995. "Why Are Judgments Less Consistent in Less Predictable Task Situations?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 63(3), pages 247-263, September.
- Yelland, Phillip M., 2006. "Stable seasonal pattern models for forecast revision: A comparative study," International Journal of Forecasting, Elsevier, vol. 22(4), pages 799-818.
- Lawrence, Michael & O'Connor, Marcus & Edmundson, Bob, 2000. "A field study of sales forecasting accuracy and processes," European Journal of Operational Research, Elsevier, vol. 122(1), pages 151-160, April.
- Gardner, Everette S. & Anderson, Elizabeth A., 1997. "Focus forecasting reconsidered," International Journal of Forecasting, Elsevier, vol. 13(4), pages 501-508, December.
- Gardner, Everette Jr., 2006. "Exponential smoothing: The state of the art--Part II," International Journal of Forecasting, Elsevier, vol. 22(4), pages 637-666.
- Buehler, Roger & Griffin, Dale, 2003. "Planning, personality, and prediction: The role of future focus in optimistic time predictions," Organizational Behavior and Human Decision Processes, Elsevier, vol. 92(1-2), pages 80-90.
- Bonaccio, Silvia & Dalal, Reeshad S., 2006. "Advice taking and decision-making: An integrative literature review, and implications for the organizational sciences," Organizational Behavior and Human Decision Processes, Elsevier, vol. 101(2), pages 127-151, November.
- Willemain, Thomas R., 1991. "The effect of graphical adjustment on forecast accuracy," International Journal of Forecasting, Elsevier, vol. 7(2), pages 151-154, August.
- Belton, Valerie & Goodwin, Paul, 1996. "Remarks on the application of the analytic hierarchy process to judgmental forecasting," International Journal of Forecasting, Elsevier, vol. 12(1), pages 155-161, March.
- Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
- Lee, Wing Yee & Goodwin, Paul & Fildes, Robert & Nikolopoulos, Konstantinos & Lawrence, Michael, 2007. "Providing support for the use of analogies in demand forecasting tasks," International Journal of Forecasting, Elsevier, vol. 23(3), pages 377-390.
- Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
- Goodwin, Paul & Lawton, Richard, 1999. "On the asymmetry of the symmetric MAPE," International Journal of Forecasting, Elsevier, vol. 15(4), pages 405-408, October.
- Thomas Åstebro & Samir Elhedhli, 2006. "The Effectiveness of Simple Decision Heuristics: Forecasting Commercial Success for Early-Stage Ventures," Management Science, INFORMS, vol. 52(3), pages 395-409, March.
- Goodwin, Paul, 2000. "Improving the voluntary integration of statistical forecasts and judgment," International Journal of Forecasting, Elsevier, vol. 16(1), pages 85-99.
- Yossi Aviv, 2001. "The Effect of Collaborative Forecasting on Supply Chain Performance," Management Science, INFORMS, vol. 47(10), pages 1326-1343, October.
- Lawrence, M. & O'Connor, M., 1996. "Judgement or models: The importance of task differences," Omega, Elsevier, vol. 24(3), pages 245-254, June.
- Moon, Mark A. & Mentzer, John T. & Smith, Carlo D., 2003. "Conducting a sales forecasting audit," International Journal of Forecasting, Elsevier, vol. 19(1), pages 5-25.
- Lim, Joa Sang & O'Connor, Marcus, 1996. "Judgmental forecasting with time series and causal information," International Journal of Forecasting, Elsevier, vol. 12(1), pages 139-153, March.
- McNees, Stephen K., 1990. "The role of judgment in macroeconomic forecasting accuracy," International Journal of Forecasting, Elsevier, vol. 6(3), pages 287-299, October.
This item has more than 25 citations. To prevent cluttering this page, these citations are listed on a separate page. reading list or among the top items on IDEAS.Access and download statisticsgeneral information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Zhang, Lei).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.