How Informative are the Subjective Density Forecasts of Macroeconomists?
In this paper, we propose a framework to evaluate the information content of subjective expert density forecasts using micro data from the ECB’s Survey of Professional Forecasters (SPF). A key aspect of our analysis is the use of scoring functions which evaluate the entire predictive densities, including an evaluation of the impact of density features such as their location, spread, skew and tail risk on density forecast performance. Overall, we find considerable heterogeneity in the performance of the surveyed densities at the individual level. Relative to a set of crude benchmark alternatives, this performance is somewhat better for GDP growth than for inflation, although in the former case it diminishes substantially with the forecast horizon. In addition, relative to the proposed benchmarks, we report evidence of some improvement in the performance of expert densities during the recent period of macroeconomic volatility. However, our analysis also reveals clear evidence of overconfidence or neglected risks in the expert probability assessments, as reflected also in frequent occurrences of events which are assigned a zero probability. Moreover, higher moment features of the expert densities, such as their skew or the degree of probability mass in their tails, are shown not to contribute significantly to improvements in individual density forecast performance.
|Date of creation:||2011|
|Contact details of provider:|| Postal: Poschingerstrasse 5, 81679 Munich|
Phone: +49 (89) 9224-0
Fax: +49 (89) 985369
Web page: http://www.cesifo-group.de
More information through EDIRC
References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Lahiri, Kajal & Teigland, Christie & Zaporowski, Mark, 1988. "Interest Rates and the Subjective Probability Distribution of Inflation Forecasts," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 20(2), pages 233-248, May.
- Geweke, John & Amisano, Gianni, 2011.
"Optimal prediction pools,"
Journal of Econometrics,
Elsevier, vol. 164(1), pages 130-141, September.
- Amisano, Gianni & Geweke, John, 2009. "Optimal Prediction Pools," Working Paper Series 1017, European Central Bank.
- repec:nsr:niesrd:320 is not listed on IDEAS
- Victor Zarnowitz & Louis A. Lambros, 1983. "Consensus and Uncertainty in Economic Prediction," NBER Working Papers 1171, National Bureau of Economic Research, Inc.
- Robert Rich & Joseph Tracy, 2010. "The Relationships among Expected Inflation, Disagreement, and Uncertainty: Evidence from Matched Point and Density Forecasts," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 200-207, February.
- Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
- Ghysels, Eric & Wright, Jonathan H., 2009. "Forecasting Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 504-516. Full references (including those not matched with items on IDEAS)