Does Disagreement amongst Forecasters have Predictive Value?
AbstractForecasts from various experts are often used in macroeconomic forecasting models. Usually the focus is on the mean or median of the survey data. In the present study we adopt a different perspective on the survey data as we examine the predictive power of disagreement amongst forecasters. The premise is that this variable could signal upcoming structural or temporal changes in an economic process or in the predictive power of the survey forecasts. In our empirical work, we examine a variety of macroeconomic variables, and we use different measurements for the degree of disagreement, together with measures for location of the survey data and autoregressive components. Forecasts from simple linear models and forecasts from Markov regime-switching models with constant and with time-varying transition probabilities are constructed in real-time and compared on forecast accuracy. We find that disagreement has predictive power indeed and that this variable can be used to improve forecasts when used in Markov regime-switching models.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Tinbergen Institute in its series Tinbergen Institute Discussion Papers with number 10-088/4.
Date of creation: 03 Sep 2010
Date of revision:
Contact details of provider:
Web page: http://www.tinbergen.nl
model forecasts; expert forecasts; survey forecasts; Markov regime-switching models; disagreement; time series;
Other versions of this item:
- Legerstee, R. & Franses, Ph.H.B.F., 2010. "Does Disagreement Amongst Forecasters have Predictive Value?," Econometric Institute Research Papers EI 2010-53, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-02-26 (All new papers)
- NEP-CBA-2011-02-26 (Central Banking)
- NEP-ETS-2011-02-26 (Econometric Time Series)
- NEP-FOR-2011-02-26 (Forecasting)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Zacharias Psaradakis & Nicola Spagnolo, 2006. "Joint Determination of the State Dimension and Autoregressive Order for Models with Markov Regime Switching," Journal of Time Series Analysis, Wiley Blackwell, vol. 27(5), pages 753-766, 09.
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- Smith, Aaron D. & Naik, Prasad A. & Tsai, Chih-Ling, 2005.
"Markov-Switching Model Selection Using Kullback-Leibler Divergence,"
11976, University of California, Davis, Department of Agricultural and Resource Economics.
- Smith, Aaron & Naik, Prasad A. & Tsai, Chih-Ling, 2006. "Markov-switching model selection using Kullback-Leibler divergence," Journal of Econometrics, Elsevier, vol. 134(2), pages 553-577, October.
- Aurelien Baillon & Laure Cabantous, 2009. "Combining imprecise or conflicting probability judgments: A choice-based study," ICBBR Working Papers 3, International Centre for Behavioural Business Research.
- Owen Lamont, 1995.
"Macroeconomics Forecasts and Microeconomic Forecasters,"
NBER Working Papers
5284, National Bureau of Economic Research, Inc.
- Lamont, Owen A., 2002. "Macroeconomic forecasts and microeconomic forecasters," Journal of Economic Behavior & Organization, Elsevier, vol. 48(3), pages 265-280, July.
- David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias In Macroeconomic Forecasts," The Quarterly Journal of Economics, MIT Press, vol. 114(1), pages 293-318, February.
- Kajal Lahiri & Xuguang Sheng, 2008.
"Measuring Forecast Uncertainty by Disagreement: The Missing Link,"
Ifo Working Paper Series
Ifo Working Paper No. 60, Ifo Institute for Economic Research at the University of Munich.
- Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
- Kajal Lahiri & Xuguang Sheng, 2009. "Measuring Forecast Uncertainty by Disagreement: The Missing Link," Discussion Papers 09-06, University at Albany, SUNY, Department of Economics.
- Webby, Richard & O'Connor, Marcus, 1996. "Judgemental and statistical time series forecasting: a review of the literature," International Journal of Forecasting, Elsevier, vol. 12(1), pages 91-118, March.
- Diebold, Francis X & Mariano, Roberto S, 1995.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 13(3), pages 253-63, July.
- Tom Doan, . "DMARIANO: RATS procedure to compute Diebold-Mariano Forecast Comparison Test," Statistical Software Components RTS00055, Boston College Department of Economics.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Timmermann, Allan, 2000.
"Moments of Markov switching models,"
Journal of Econometrics,
Elsevier, vol. 96(1), pages 75-111, May.
- Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
- Victor Zarnowitz & Louis A. Lambros, 1983. "Consensus and Uncertainty in Economic Prediction," NBER Working Papers 1171, National Bureau of Economic Research, Inc.
- Graham Elliott & Allan Timmermann, 2005.
"Optimal Forecast Combination Under Regime Switching ,"
International Economic Review,
Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(4), pages 1081-1102, November.
- Elliott, Graham & Timmermann, Allan G, 2004. "Optimal Forecast Combination Under Regime Switching," CEPR Discussion Papers 4649, C.E.P.R. Discussion Papers.
- Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
- Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
- Badarinza, Cristian & Buchmann, Marco, 2011. "Macroeconomic vulnerability and disagreement in expectations," Working Paper Series 1407, European Central Bank.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Antoine Maartens (+31 626 - 160 892)).
If references are entirely missing, you can add them using this form.