Evaluating DSGE model forecasts of comovements
Abstract
This paper develops and applies tools to assess multivariate aspects of Bayesian Dynamic Stochastic General Equilibrium (DSGE) model forecasts and their ability to predict comovements among key macroeconomic variables. We construct posterior predictive checks to evaluate conditional and unconditional density forecasts, in addition to checks for root-mean-squared errors and event probabilities associated with these forecasts. The checks are implemented on a three-equation DSGE model as well as the Smets and Wouters (2007) model using real-time data. We find that the additional features incorporated into the Smets–Wouters model do not lead to a uniform improvement in the quality of density forecasts and prediction of comovements of output, inflation, and interest rates.Download Info
If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic Info
Article provided by Elsevier in its journal Journal of Econometrics.
Volume (Year): 171 (2012)
Issue (Month): 2 ()
Pages: 152-166
Contact details of provider:
Web page: http://www.elsevier.com/locate/jeconom
Related research
Keywords: Bayesian methods; DSGE models; Forecast evaluation; Macroeconomic forecasting;Other versions of this item:
- Edward Herbst & Frank Schorfheide, 2011. "Evaluating DSGE model forecasts of comovements," Working Papers 11-5, Federal Reserve Bank of Philadelphia.
- Edward Herbst & Frank Schorfheide, 2012. "Evaluating DSGE model forecasts of comovements," Finance and Economics Discussion Series 2012-11, Board of Governors of the Federal Reserve System (U.S.).
- C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
- C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- E27 - Macroeconomics and Monetary Economics - - Macroeconomics: Consumption, Saving, Production, Employment, and Investment - - - Forecasting and Simulation: Models and Applications
- E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications
References
References listed on IDEASPlease report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Frank Schorfheide & Keith Sill & Maxym Kryshko, 2008.
"DSGE model-based forecasting of non-modelled variables,"
Working Papers
08-17, Federal Reserve Bank of Philadelphia.
- Schorfheide, Frank & Sill, Keith & Kryshko, Maxym, 2010. "DSGE model-based forecasting of non-modelled variables," International Journal of Forecasting, Elsevier, vol. 26(2), pages 348-373, April.
- Frank Schorfheide & Keith Sill & Maxym Kryshko, 2009. "DSGE Model-Based Forecasting of Non-modelled Variables," NBER Working Papers 14872, National Bureau of Economic Research, Inc.
- Smets, Frank & Wouters, Rafael, 2007.
"Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach,"
CEPR Discussion Papers
6112, C.E.P.R. Discussion Papers.
- Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
- Frank Smets & Raf Wouters, 2007. "Shocks and Frictions in US Business Cycles : a Bayesian DSGE Approach," Working Paper Research 109, National Bank of Belgium.
- Frank Smets & Rafael Wouters, 2007. "Shocks and frictions in US business cycles: a Bayesian DSGE approach," Working Paper Series 722, European Central Bank.
- Kling, John L & Bessler, David A, 1989. "Calibration-Based Predictive Distributions: An Application of Prequential Analysis to Interest Rates, Money, Prices, and Output," The Journal of Business, University of Chicago Press, vol. 62(4), pages 477-99, October.
- Kai Christoffel & Günter Coenen & Anders Warne, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
- Lawrence J. Christiano & Martin Eichenbaum & Charles Evans, 2001.
"Nominal rigidities and the dynamic effects of a shock to monetary policy,"
Proceedings,
Federal Reserve Bank of San Francisco, issue Jun.
- Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
- Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2001. "Nominal rigidities and the dynamic effects of a shock to monetary policy," Working Paper Series WP-01-08, Federal Reserve Bank of Chicago.
- Lawrence J. Christiano & Martin Eichenbaum & Charles Evans, 2001. "Nominal rigidities and the dynamic effects of a shock to monetary policy," Working Paper 0107, Federal Reserve Bank of Cleveland.
- Lawrence J. Christiano & Martin Eichenbaum & Charles Evans, 2001. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," NBER Working Papers 8403, National Bureau of Economic Research, Inc.
- Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268.
- Kydland, Finn E & Prescott, Edward C, 1982.
"Time to Build and Aggregate Fluctuations,"
Econometrica,
Econometric Society, vol. 50(6), pages 1345-70, November.
- Finn E. Kydland & Edward C. Prescott, 1982. "Web interface for "Time to Build and Aggregate Fluctuations"," QM&RBC Codes 4a, Quantitative Macroeconomics & Real Business Cycles.
- Finn E. Kydland & Edward C. Prescott, 1982. "Executable program for "Time to Build and Aggregate Fluctuations"," QM&RBC Codes 4, Quantitative Macroeconomics & Real Business Cycles.
- Wolters, Maik H., 2011. "Forecasting under Model Uncertainty," Annual Conference 2011 (Frankfurt, Main): The Order of the World Economy - Lessons from the Crisis 48723, Verein für Socialpolitik / German Economic Association.
- Frank Schorfheide, 2008. "DSGE model-based estimation of the New Keynesian Phillips curve," Economic Quarterly, Federal Reserve Bank of Richmond, issue Fall, pages 397-433.
- Daniel F. Waggoner & Tao Zha, 1998.
"Conditional forecasts in dynamic multivariate models,"
Working Paper
98-22, Federal Reserve Bank of Atlanta.
- Daniel F. Waggoner & Tao Zha, 1999. "Conditional Forecasts In Dynamic Multivariate Models," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 639-651, November.
- Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-83, November.
- John Geweke, 2007. "Bayesian Model Comparison and Validation," American Economic Review, American Economic Association, vol. 97(2), pages 60-64, May.
- Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
- Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2008.
"A Comparison Of Forecast Performance Between Federal Reserve Staff Forecasts, Simple Reduced-Form Models, And A Dsge Model,"
CAMA Working Papers
2009-03, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
- Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2009. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Finance and Economics Discussion Series 2009-10, Board of Governors of the Federal Reserve System (U.S.).
- Edge, Rochelle M & Gürkaynak, Refet S., 2010.
"How Useful Are Estimated DSGE Model Forecasts for Central Bankers?,"
CEPR Discussion Papers
8158, C.E.P.R. Discussion Papers.
- Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
- Frank Smets & Raf Wouters, 2003.
"An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area,"
Journal of the European Economic Association,
MIT Press, vol. 1(5), pages 1123-1175, 09.
- Frank Smets & Raf Wouters, 2002. "An estimated dynamic stochastic general equilibrium model of the euro area," Working Paper Research 35, National Bank of Belgium.
- Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1999. "Multivariate Density Forecast Evaluation And Calibration In Financial Risk Management: High-Frequency Returns On Foreign Exchange," The Review of Economics and Statistics, MIT Press, vol. 81(4), pages 661-673, November.
- Marco Del Negro & Frank Schorfheide, 2012. "DSGE model-based forecasting," Staff Reports 554, Federal Reserve Bank of New York.
- Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.Cited by:
- Wolters, Maik Hendrik, 2012. "Evaluating point and density forecasts of DSGE models," MPRA Paper 36147, University Library of Munich, Germany.
- Casares, Miguel & Vázquez Pérez, Jesús, 2012.
"Data Revisions in the Estimation of DSGE Models,"
DFAEII Working Papers
2012-06, University of the Basque Country - Department of Foundations of Economic Analysis II.
- Miguel Casares & Jesús Vázquez, 2011. "Data Revisions in the Estimation of DSGE models," Documentos de Trabajo - Lan Gaiak Departamento de EconomÃa - Universidad Pública de Navarra 1104, Departamento de Economía - Universidad Pública de Navarra.
- Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2012.
"Was the Recent Downturn in US GDP Predictable?,"
Working Papers
1210, University of Nevada, Las Vegas , Department of Economics.
- Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2012. "Was the Recent Downturn in US GDP Predictable?," Working papers 2012-38, University of Connecticut, Department of Economics.
- Mehmet Balcilar & Rangan Gupta & Anandamayee Majumdar & Stephen M. Miller, 2012. "Was the Recent Downturn in US GDP Predictable?," Working Papers 201230, University of Pretoria, Department of Economics.
- Marco Del Negro & Frank Schorfheide, 2012. "DSGE model-based forecasting," Staff Reports 554, Federal Reserve Bank of New York.
- Frank Schorfheide & Dongho Song, 2012. "Real-time forecasting with a mixed-frequency VAR," Working Papers 701, Federal Reserve Bank of Minneapolis.
Lists
This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.Statistics
Access and download statisticsCorrections
When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:171:y:2012:i:2:p:152-166For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wendy Shamier).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.

