On the relative importance of linear model and human judge(s) in combined forecasting
When and to what extent should forecasts rely on linear model or human judgment? The judgmental forecasting literature suggests that aggregating model and judge using a simple 50:50 split tends to outperform the two inputs alone. However, current research disregards the important role that the structure of the task, judges’ level of expertise, and the number of individuals providing a forecasting judgment may play. Ninety-two music industry professionals and 88 postgraduate students were recruited in a field experiment to predict chart entry positions of pop music singles in the UK and Germany. The results of a lens model analysis show how task structure and domain-specific expertise moderate the relative importance of model and judge. The study also delineates an upper boundary to which aggregating multiple judgments in model-expert combinations adds predictive accuracy. It is suggested that ignoring the characteristics of task and/or judge may lead to suboptimal forecasting performance.
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Volume (Year): 120 (2013)
Issue (Month): 1 ()
|Contact details of provider:|| Web page: http://www.elsevier.com/locate/obhdp|
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Hoch, Stephen J, 1988. " Who Do We Know: Predicting the Interests and Opinions of the American Consumer," Journal of Consumer Research, Oxford University Press, vol. 15(3), pages 315-324, December.
- Goodwin, Paul, 2000. "Correct or combine? Mechanically integrating judgmental forecasts with statistical methods," International Journal of Forecasting, Elsevier, vol. 16(2), pages 261-275.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- de Menezes, Lilian M. & W. Bunn, Derek & Taylor, James W., 2000. "Review of guidelines for the use of combined forecasts," European Journal of Operational Research, Elsevier, vol. 120(1), pages 190-204, January.
- Stewart, Thomas R. & Roebber, Paul J. & Bosart, Lance F., 1997. "The Importance of the Task in Analyzing Expert Judgment," Organizational Behavior and Human Decision Processes, Elsevier, vol. 69(3), pages 205-219, March.
- Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
- M. J. Lawrence & R. H. Edmundson & M. J. O'Connor, 1986. "The Accuracy of Combining Judgemental and Statistical Forecasts," Management Science, INFORMS, vol. 32(12), pages 1521-1532, December.
- Bunn, Derek W., 1985. "Statistical efficiency in the linear combination of forecasts," International Journal of Forecasting, Elsevier, vol. 1(2), pages 151-163.
- Camerer, Colin & Weber, Martin, 1992. "Recent Developments in Modeling Preferences: Uncertainty and Ambiguity," Journal of Risk and Uncertainty, Springer, vol. 5(4), pages 325-370, October.
- Ashton, Robert H., 1986. "Combining the judgments of experts: How many and which ones?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 38(3), pages 405-414, December.
- Deng, Pi-Sheng, 1996. "Using case-based reasoning approach to the support of ill-structured decisions," European Journal of Operational Research, Elsevier, vol. 93(3), pages 511-521, September.
- Makridakis, Spyros & Chatfield, Chris & Hibon, Michele & Lawrence, Michael & Mills, Terence & Ord, Keith & Simmons, LeRoy F., 1993. "The M2-competition: A real-time judgmentally based forecasting study," International Journal of Forecasting, Elsevier, vol. 9(1), pages 5-22, April.
- Stephen J. Hoch & David A. Schkade, 1996. "A Psychological Approach to Decision Support Systems," Management Science, INFORMS, vol. 42(1), pages 51-64, January.
- Briner, Rob B. & Rousseau, Denise M., 2011. "Evidence-Based I–O Psychology: Not There Yet," Industrial and Organizational Psychology, Cambridge University Press, vol. 4(01), pages 3-22, March.
- Wood, Robert E., 1986. "Task complexity: Definition of the construct," Organizational Behavior and Human Decision Processes, Elsevier, vol. 37(1), pages 60-82, February.
- Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
- Camerer, Colin & Weber, Martin, 1992.
"Recent Developments in Modeling Preferences: Uncertainty and Ambiguity,"
Journal of Risk and Uncertainty,
Springer, vol. 5(4), pages 325-370, October.
- Camerer, Colin F. & Weber, Martin, 1991. "Recent developments in modelling preferences: Uncertainty and ambiguitiy," Manuskripte aus den Instituten für Betriebswirtschaftslehre der Universität Kiel 275, Christian-Albrechts-Universität zu Kiel, Institut für Betriebswirtschaftslehre.
- Alexander, John C, Jr, 1995. "Refining the Degree of Earnings Surprise: A Comparison of Statistical and Analysts' Forecasts," The Financial Review, Eastern Finance Association, vol. 30(3), pages 469-506, August. Full references (including those not matched with items on IDEAS)
When requesting a correction, please mention this item's handle: RePEc:eee:jobhdp:v:120:y:2013:i:1:p:24-36. See general information about how to correct material in RePEc.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu)
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.