Does Disagreement amongst Forecasters have Predictive Value?
AbstractForecasts from various experts are often used in macroeconomic forecasting models. Usually the focus is on the mean or median of the survey data. In the present study we adopt a different perspective on the survey data as we examine the predictive power of disagreement amongst forecasters. The premise is that this variable could signal upcoming structural or temporal changes in an economic process or in the predictive power of the survey forecasts. In our empirical work, we examine a variety of macroeconomic variables, and we use different measurements for the degree of disagreement, together with measures for location of the survey data and autoregressive components. Forecasts from simple linear models and forecasts from Markov regime-switching models with constant and with time-varying transition probabilities are constructed in real-time and compared on forecast accuracy. We find that disagreement has predictive power indeed and that this variable can be used to improve forecasts when used in Markov regime-switching models.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by Tinbergen Institute in its series Tinbergen Institute Discussion Papers with number 10-088/4.
Date of creation: 03 Sep 2010
Date of revision:
Contact details of provider:
Web page: http://www.tinbergen.nl
model forecasts; expert forecasts; survey forecasts; Markov regime-switching models; disagreement; time series;
Other versions of this item:
- Legerstee, R. & Franses, Ph.H.B.F., 2010. "Does Disagreement Amongst Forecasters have Predictive Value?," Econometric Institute Research Papers EI 2010-53, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
This paper has been announced in the following NEP Reports:
- NEP-ALL-2011-02-26 (All new papers)
- NEP-CBA-2011-02-26 (Central Banking)
- NEP-ETS-2011-02-26 (Econometric Time Series)
- NEP-FOR-2011-02-26 (Forecasting)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Clemen, Robert T., 1989. "Combining forecasts: A review and annotated bibliography," International Journal of Forecasting, Elsevier, vol. 5(4), pages 559-583.
- Diebold, Francis X & Mariano, Roberto S, 1995.
"Comparing Predictive Accuracy,"
Journal of Business & Economic Statistics,
American Statistical Association, vol. 13(3), pages 253-63, July.
- Francis X. Diebold & Robert S. Mariano, 1994. "Comparing Predictive Accuracy," NBER Technical Working Papers 0169, National Bureau of Economic Research, Inc.
- Tom Doan, . "DMARIANO: RATS procedure to compute Diebold-Mariano Forecast Comparison Test," Statistical Software Components RTS00055, Boston College Department of Economics.
- Graham Elliott & Allan Timmermann, 2005.
"Optimal Forecast Combination Under Regime Switching ,"
International Economic Review,
Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 46(4), pages 1081-1102, November.
- Elliott, Graham & Timmermann, Allan G, 2004. "Optimal Forecast Combination Under Regime Switching," CEPR Discussion Papers 4649, C.E.P.R. Discussion Papers.
- David Laster & Paul Bennett & In Sun Geoum, 1999. "Rational Bias In Macroeconomic Forecasts," The Quarterly Journal of Economics, MIT Press, vol. 114(1), pages 293-318, February.
- Kajal Lahiri & Xuguang Sheng, 2009.
"Measuring Forecast Uncertainty by Disagreement: The Missing Link,"
09-06, University at Albany, SUNY, Department of Economics.
- Kajal Lahiri & Xuguang Sheng, 2010. "Measuring forecast uncertainty by disagreement: The missing link," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 514-538.
- Kajal Lahiri & Xuguang Sheng, 2008. "Measuring Forecast Uncertainty by Disagreement: The Missing Link," Ifo Working Paper Series Ifo Working Paper No. 60, Ifo Institute for Economic Research at the University of Munich.
- Lamont, Owen A., 2002.
"Macroeconomic forecasts and microeconomic forecasters,"
Journal of Economic Behavior & Organization,
Elsevier, vol. 48(3), pages 265-280, July.
- Owen Lamont, 1995. "Macroeconomics Forecasts and Microeconomic Forecasters," NBER Working Papers 5284, National Bureau of Economic Research, Inc.
- Victor Zarnowitz & Louis A. Lambros, 1987. "Consensus and Uncertainty in Economic Prediction," NBER Working Papers 1171, National Bureau of Economic Research, Inc.
- Harvey, David & Leybourne, Stephen & Newbold, Paul, 1997. "Testing the equality of prediction mean squared errors," International Journal of Forecasting, Elsevier, vol. 13(2), pages 281-291, June.
- Zacharias Psaradakis & Nicola Spagnolo, 2006. "Joint Determination of the State Dimension and Autoregressive Order for Models with Markov Regime Switching," Journal of Time Series Analysis, Wiley Blackwell, vol. 27(5), pages 753-766, 09.
- Allan Timmermann, 1999.
"Moments of Markov Switching Models,"
FMG Discussion Papers
dp323, Financial Markets Group.
- Mc Cracken, Michael W., 2000. "Robust out-of-sample inference," Journal of Econometrics, Elsevier, vol. 99(2), pages 195-223, December.
- Smith, Aaron D. & Naik, Prasad A. & Tsai, Chih-Ling, 2005.
"Markov-Switching Model Selection Using Kullback-Leibler Divergence,"
11976, University of California, Davis, Department of Agricultural and Resource Economics.
- Smith, Aaron & Naik, Prasad A. & Tsai, Chih-Ling, 2006. "Markov-switching model selection using Kullback-Leibler divergence," Journal of Econometrics, Elsevier, vol. 134(2), pages 553-577, October.
- Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
- Webby, Richard & O'Connor, Marcus, 1996. "Judgemental and statistical time series forecasting: a review of the literature," International Journal of Forecasting, Elsevier, vol. 12(1), pages 91-118, March.
- Badarinza, Cristian & Buchmann, Marco, 2011. "Macroeconomic vulnerability and disagreement in expectations," Working Paper Series 1407, European Central Bank.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Antoine Maartens (+31 626 - 160 892)).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.