Prediction using several macroeconomic models
AbstractPrediction of macroeconomic aggregates is one of the primary functions of macroeconometric models, including dynamic factor models, dynamic stochastic general equilibrium models, and vector autoregressions. This study establishes methods that improve the predictions of these models, using a representative model from each class and a canonical 7-variable postwar US data set. It focuses on prediction over the period 1966 through 2011. It measures the quality of prediction by the probability densities assigned to the actual values of these variables, one quarter ahead, by the predictive distributions of the models in real time. Two steps lead to substantial improvement. The first is to use full Bayesian predictive distributions rather than substitute a "plug-in" posterior mode for parameters. Across models and quarters, this leads to a mean improvement in probability of 50.4%. The second is to use an equally-weighted pool of predictive densities from the three models, which leads to a mean improvement in probability of 41.9% over the full Bayesian predictive distributions of the individual models. This improvement is much better than that a¤orded by Bayesian model averaging. The study uses several analytical tools, including pooling, analysis of predictive variance, and probability integral transform tests, to understand and interpret the improvements. JEL Classification: C11, C51 C53
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
Bibliographic InfoPaper provided by European Central Bank in its series Working Paper Series with number 1537.
Date of creation: Apr 2013
Date of revision:
Contact details of provider:
Postal: Postfach 16 03 19, Frankfurt am Main, Germany
Phone: +49 69 1344 0
Fax: +49 69 1344 6000
Web page: http://www.ecb.europa.eu/home/html/index.en.html
More information through EDIRC
Postal: Press and Information Division, European Central Bank, Kaiserstrasse 29, 60311 Frankfurt am Main, Germany
Find related papers by JEL classification:
- C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
- C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
This paper has been announced in the following NEP Reports:
- NEP-ALL-2013-08-23 (All new papers)
- NEP-ECM-2013-08-23 (Econometrics)
- NEP-FOR-2013-08-23 (Forecasting)
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Peter N. Ireland, 1999.
"A Method for Taking Models to the Data,"
Boston College Working Papers in Economics
421, Boston College Department of Economics.
- Peter N. Ireland, 1999. "A method for taking models to the data," Working Paper 9903, Federal Reserve Bank of Cleveland.
- Peter Ireland, 1999. "Matlab code for A Method for Taking Models to the Data," QM&RBC Codes 46, Quantitative Macroeconomics & Real Business Cycles.
- Peter Ireland, 1999. "A Method for Taking Models to the Data," Computing in Economics and Finance 1999 1233, Society for Computational Economics.
- Robert B. Litterman, 1985.
"Forecasting with Bayesian vector autoregressions five years of experience,"
274, Federal Reserve Bank of Minneapolis.
- Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
- Frank Smets & Raf Wouters, 2007.
"Shocks and Frictions in US Business Cycles : a Bayesian DSGE Approach,"
Working Paper Research
109, National Bank of Belgium.
- Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
- Smets, Frank & Wouters, Raf, 2007. "Shocks and frictions in US business cycles: a Bayesian DSGE approach," Working Paper Series 0722, European Central Bank.
- Smets, Frank & Wouters, Rafael, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," CEPR Discussion Papers 6112, C.E.P.R. Discussion Papers.
- Bernanke, Ben S. & Boivin, Jean, 2003.
"Monetary policy in a data-rich environment,"
Journal of Monetary Economics,
Elsevier, vol. 50(3), pages 525-546, April.
- Sargent, Thomas J, 1989. "Two Models of Measurements and the Investment Accelerator," Journal of Political Economy, University of Chicago Press, vol. 97(2), pages 251-87, April.
- Geweke, John & Amisano, Gianni, 2011.
"Optimal prediction pools,"
Journal of Econometrics,
Elsevier, vol. 164(1), pages 130-141, September.
- Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-74, October.
- Frank Smets & Raf Wouters, 2002.
"An estimated dynamic stochastic general equilibrium model of the euro area,"
Working Paper Research
35, National Bank of Belgium.
- Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, 09.
- Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2003.
"The Generalized Dynamic Factor Model. One-Sided Estimation and Forecasting,"
LEM Papers Series
2003/13, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
- Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2005. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 830-840, September.
- Forni, Mario & Hallin, Marc & Lippi, Marco & Reichlin, Lucrezia, 2002. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," CEPR Discussion Papers 3432, C.E.P.R. Discussion Papers.
- Forni M. & Hallin M., 2003. "The Generalized Dynamic Factor Model: One-Sided Estimation and Forecasting," Computing in Economics and Finance 2003 143, Society for Computational Economics.
- Mario Forni & Marc Hallin & Marco Lippi & Lucrezia Reichlin, 2005. "The generalised dynamic factor model: one sided estimation and forecasting," ULB Institutional Repository 2013/10129, ULB -- Universite Libre de Bruxelles.
- An, Sungbae & Schorfheide, Frank, 2005.
"Bayesian Analysis of DSGE Models,"
CEPR Discussion Papers
5207, C.E.P.R. Discussion Papers.
- Ingram, Beth F. & Whiteman, Charles H., 1994. "Supplanting the 'Minnesota' prior: Forecasting macroeconomic time series using real business cycle model priors," Journal of Monetary Economics, Elsevier, vol. 34(3), pages 497-510, December.
- James H. Stock & Mark W. Watson, 2005. "Implications of Dynamic Factor Models for VAR Analysis," NBER Working Papers 11467, National Bureau of Economic Research, Inc.
- Marco Del Negro & Frank Schorfheide, 2004.
"Priors from General Equilibrium Models for VARS,"
International Economic Review,
Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, 05.
- Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
- Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models—Rejoinder," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 211-219.
- Kenneth Wallis, 2011. "Combining forecasts - forty years later," Applied Financial Economics, Taylor & Francis Journals, vol. 21(1-2), pages 33-41.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Official Publications).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.