How Informative are the Subjective Density Forecasts of Macroeconomists?
AbstractIn this paper, we propose a framework to evaluate the information content of subjective expert density forecasts using micro data from the ECB’s Survey of Professional Forecasters (SPF). A key aspect of our analysis is the use of scoring functions which evaluate the entire predictive densities, including an evaluation of the impact of density features such as their location, spread, skew and tail risk on density forecast performance. Overall, we find considerable heterogeneity in the performance of the surveyed densities at the individual level. Relative to a set of crude benchmark alternatives, this performance is somewhat better for GDP growth than for inflation, although in the former case it diminishes substantially with the forecast horizon. In addition, relative to the proposed benchmarks, we report evidence of some improvement in the performance of expert densities during the recent period of macroeconomic volatility. However, our analysis also reveals clear evidence of overconfidence or neglected risks in the expert probability assessments, as reflected also in frequent occurrences of events which are assigned a zero probability. Moreover, higher moment features of the expert densities, such as their skew or the degree of probability mass in their tails, are shown not to contribute significantly to improvements in individual density forecast performance.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by CESifo Group Munich in its series CESifo Working Paper Series with number 3671.
Date of creation: 2011
Date of revision:
density forecasts; forecast evaluation; real-time data; Survey of Professional Forecasters;
Other versions of this item:
- Geoff Kenny & Thomas Kostka & Federico Masera, 2014. "How Informative are the Subjective Density Forecasts of Macroeconomists?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(3), pages 163-185, 04.
- Kenny, Geoff & Kostka, Thomas & Masera, Federico, 2012. "How informative are the subjective density forecasts of macroeconomists?," Working Paper Series, European Central Bank 1446, European Central Bank.
- C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models &bull Diffusion Processes
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Victor Zarnowitz & Louis A. Lambros, 1983. "Consensus and Uncertainty in Economic Prediction," NBER Working Papers 1171, National Bureau of Economic Research, Inc.
- Zarnowitz, Victor & Lambros, Louis A, 1987. "Consensus and Uncertainty in Economic Prediction," Journal of Political Economy, University of Chicago Press, University of Chicago Press, vol. 95(3), pages 591-621, June.
- Robert Rich & Joseph Tracy, 2010. "The Relationships among Expected Inflation, Disagreement, and Uncertainty: Evidence from Matched Point and Density Forecasts," The Review of Economics and Statistics, MIT Press, vol. 92(1), pages 200-207, February.
- Ghysels, Eric & Wright, Jonathan H., 2009. "Forecasting Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, American Statistical Association, vol. 27(4), pages 504-516.
- Geweke, John & Amisano, Gianni, 2011.
"Optimal prediction pools,"
Journal of Econometrics, Elsevier,
Elsevier, vol. 164(1), pages 130-141, September.
- Geweke, John & Amisano, Gianni, 2009. "Optimal Prediction Pools," Working Paper Series, European Central Bank 1017, European Central Bank.
- John Geweke & Gianni Amisano, 2008. "Optimal Prediction Pools," Working Paper Series, The Rimini Centre for Economic Analysis 22-08, The Rimini Centre for Economic Analysis, revised Jan 2008.
- repec:nsr:niesrd:320 is not listed on IDEAS
- Paloviita, Maritta & Viren, Matti, 2012. "Inflation and output growth uncertainty in individual survey expectations," Research Discussion Papers, Bank of Finland 37/2012, Bank of Finland.
- Kenny, Geoff & Kostka, Thomas & Masera, Federico, 2013. "Can macroeconomists forecast risk? Event-based evidence from the euro area SPF," Working Paper Series, European Central Bank 1540, European Central Bank.
- Robert Rich & Joseph Song & Joseph Tracy, 2012. "The measurement and behavior of uncertainty: evidence from the ECB Survey of Professional Forecasters," Staff Reports, Federal Reserve Bank of New York 588, Federal Reserve Bank of New York.
- Clements, Michael P, 2012. "Subjective and Ex Post Forecast Uncertainty : US Inflation and Output Growth," The Warwick Economics Research Paper Series (TWERPS) 995, University of Warwick, Department of Economics.
- Maritta Paloviita and Matti Viren, 2012. "Are individual survey expectations internally consistent?," Discussion Papers, Aboa Centre for Economics 77, Aboa Centre for Economics.
- Paloviita, Maritta & Viren, Matti, 2014. "Analysis of forecast errors in micro-level survey data," Research Discussion Papers, Bank of Finland 8/2014, Bank of Finland.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Julio Saavedra).
If references are entirely missing, you can add them using this form.