How informative are the subjective density forecasts of macroeconomists?
AbstractIn this paper, we propose a framework to evaluate the subjective density forecasts of macroeconomists using micro data from the euro area Survey of Professional Forecasters (SPF). A key aspect of our analysis is the evaluation of the entire predictive densities, including an evaluation of the impact of density features such as location, spread, skew and tail risk on density forecast performance. Overall, we find considerable heterogeneity in the performance of the surveyed densities at the individual level. Relative to a set of simple benchmarks, this performance is somewhat better for GDP growth than for inflation, although in the former case it diminishes substantially with the forecast horizon. In addition, we report evidence of some improvement in the relative performance of expert densities during the recent period of macroeconomic volatility. However, our analysis also reveals clear evidence of overconfidence or neglected risks in expert probability assessments, as reflected in frequent occurrences of events which are assigned a zero probability. Moreover, higher moment features of expert densities, such as skew or the degree of probability mass in their tails, are shown not to contribute significantly to improvements in individual density forecast performance. JEL Classification: C22, C53
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by European Central Bank in its series Working Paper Series with number 1446.
Date of creation: Jul 2012
Date of revision:
Contact details of provider:
Postal: Postfach 16 03 19, Frankfurt am Main, Germany
Phone: +49 69 1344 0
Fax: +49 69 1344 6000
Web page: http://www.ecb.europa.eu/home/html/index.en.html
More information through EDIRC
Postal: Press and Information Division, European Central Bank, Kaiserstrasse 29, 60311 Frankfurt am Main, Germany
Other versions of this item:
- Geoff Kenny & Thomas Kostka & Federico Masera, 2011. "How Informative are the Subjective Density Forecasts of Macroeconomists?," CESifo Working Paper Series 3671, CESifo Group Munich.
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models &bull Diffusion Processes
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
This paper has been announced in the following NEP Reports:
- NEP-ALL-2012-09-16 (All new papers)
- NEP-FOR-2012-09-16 (Forecasting)
- NEP-MAC-2012-09-16 (Macroeconomics)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Ghysels, Eric & Wright, Jonathan H., 2009. "Forecasting Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 504-516.
- Geweke, John & Amisano, Gianni, 2011.
"Optimal prediction pools,"
Journal of Econometrics,
Elsevier, vol. 164(1), pages 130-141, September.
- Robert Rich & Joseph Tracy, 2010. "The Relationships among Expected Inflation, Disagreement, and Uncertainty: Evidence from Matched Point and Density Forecasts," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 200-207, February.
- repec:nsr:niesrd:320 is not listed on IDEAS
- Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, vol. 95(3), pages 591-621, June.
- Victor Zarnowitz & Louis A. Lambros, 1983. "Consensus and Uncertainty in Economic Prediction," NBER Working Papers 1171, National Bureau of Economic Research, Inc.
- Kenny, Geoff & Kostka, Thomas & Masera, Federico, 2013. "Can macroeconomists forecast risk? Event-based evidence from the euro area SPF," Working Paper Series 1540, European Central Bank.
- Robert Rich & Joseph Song & Joseph Tracy, 2012. "The measurement and behavior of uncertainty: evidence from the ECB Survey of Professional Forecasters," Staff Reports 588, Federal Reserve Bank of New York.
- Paloviita, Maritta & Viren, Matti, 2012. "Inflation and output growth uncertainty in individual survey expectations," Research Discussion Papers 37/2012, Bank of Finland.
- Clements, Michael P, 2012. "Subjective and Ex Post Forecast Uncertainty : US Inflation and Output Growth," The Warwick Economics Research Paper Series (TWERPS) 995, University of Warwick, Department of Economics.
- Maritta Paloviita and Matti Viren, 2012. "Are individual survey expectations internally consistent?," Discussion Papers 77, Aboa Centre for Economics.
- Paloviita, Maritta & Viren, Matti, 2014. "Analysis of forecast errors in micro-level survey data," Research Discussion Papers 8/2014, Bank of Finland.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Official Publications).
If references are entirely missing, you can add them using this form.