IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/26718.html
   My bibliography  Save this paper

A Forecasting Metric for Evaluating DSGE Models for Policy Analysis

Author

Listed:
  • Gupta, Abhishek

Abstract

This paper evaluates the strengths and weaknesses of dynamic stochastic general equilibrium (DSGE) models from the standpoint of their usefulness in doing monetary policy analysis. The paper isolates features most relevant for monetary policymaking and uses the diagnostic tools of posterior predictive analysis to evaluate these features. The paper provides a diagnosis of the observed flaws in the model with regards to these features that helps in identifying the structural flaws in the model. The paper finds that model misspecification causes certain pairs of structural shocks in the model to be correlated in order to fit the observed data.

Suggested Citation

  • Gupta, Abhishek, 2010. "A Forecasting Metric for Evaluating DSGE Models for Policy Analysis," MPRA Paper 26718, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:26718
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/26718/1/MPRA_paper_26718.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Faust, Jon & Gupta, Abhishek, 2010. "Posterior Predictive Analysis for Evaluating DSGE Models," MPRA Paper 26721, University Library of Munich, Germany.
    2. Finn E. Kydland & Edward C. Prescott, 1996. "The Computational Experiment: An Econometric Tool," Journal of Economic Perspectives, American Economic Association, vol. 10(1), pages 69-85, Winter.
    3. Hansen, Bruce E., 2005. "Challenges For Econometric Model Selection," Econometric Theory, Cambridge University Press, vol. 21(1), pages 60-68, February.
    4. Malin Adolfson & Michael K. Andersson & Jesper Lindé & Mattias Villani & Anders Vredin, 2007. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 111-144, December.
    5. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    6. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    7. Calvo, Guillermo A., 1983. "Staggered prices in a utility-maximizing framework," Journal of Monetary Economics, Elsevier, vol. 12(3), pages 383-398, September.
    8. Frank Smets & Raf Wouters, 2004. "Forecasting with a Bayesian DSGE Model: An Application to the Euro Area," Journal of Common Market Studies, Wiley Blackwell, vol. 42(4), pages 841-867, November.
    9. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    10. John Geweke, 2007. "Bayesian Model Comparison and Validation," American Economic Review, American Economic Association, vol. 97(2), pages 60-64, May.
    11. Edge, Rochelle M. & Kiley, Michael T. & Laforte, Jean-Philippe, 2008. "Natural rate measures in an estimated DSGE model of the U.S. economy," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2512-2535, August.
    12. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. John B. Taylor & Volker Wieland, 2012. "Surprising Comparative Properties of Monetary Models: Results from a New Model Database," The Review of Economics and Statistics, MIT Press, vol. 94(3), pages 800-816, August.
    2. Faust, Jon & Gupta, Abhishek, 2010. "Posterior Predictive Analysis for Evaluating DSGE Models," MPRA Paper 26721, University Library of Munich, Germany.
    3. Jon Faust, 2012. "DSGE Models: I Smell a Rat (and It Smells Good)," International Journal of Central Banking, International Journal of Central Banking, vol. 8(1), pages 53-64, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    2. repec:zbw:cfswop:wp201008 is not listed on IDEAS
    3. Faust, Jon & Gupta, Abhishek, 2010. "Posterior Predictive Analysis for Evaluating DSGE Models," MPRA Paper 26721, University Library of Munich, Germany.
    4. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    5. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    6. Negro, Marco Del & Schorfheide, Frank, 2013. "DSGE Model-Based Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 57-140, Elsevier.
    7. Schorfheide, Frank & Sill, Keith & Kryshko, Maxym, 2010. "DSGE model-based forecasting of non-modelled variables," International Journal of Forecasting, Elsevier, vol. 26(2), pages 348-373, April.
    8. Ulrich Gunter, 2019. "Estimating and forecasting with a two-country DSGE model of the Euro area and the USA: the merits of diverging interest-rate rules," Empirical Economics, Springer, vol. 56(4), pages 1283-1323, April.
    9. Cai, Michael & Del Negro, Marco & Giannoni, Marc P. & Gupta, Abhi & Li, Pearl & Moszkowski, Erica, 2019. "DSGE forecasts of the lost recovery," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1770-1789.
    10. Wieland, Volker & Wolters, Maik, 2013. "Forecasting and Policy Making," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 239-325, Elsevier.
    11. Ana Beatriz Galvão & Liudas Giraitis & George Kapetanios & Katerina Petrova, 2015. "A Bayesian Local Likelihood Method for Modelling Parameter Time Variation in DSGE Models," Working Papers 770, Queen Mary University of London, School of Economics and Finance.
    12. Marcin Kolasa & Michał Rubaszek & Paweł Skrzypczyński, 2012. "Putting the New Keynesian DSGE Model to the Real‐Time Forecasting Test," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(7), pages 1301-1324, October.
    13. Lindé, J. & Smets, F. & Wouters, R., 2016. "Challenges for Central Banks’ Macro Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 2185-2262, Elsevier.
    14. Herbst, Edward & Schorfheide, Frank, 2012. "Evaluating DSGE model forecasts of comovements," Journal of Econometrics, Elsevier, vol. 171(2), pages 152-166.
    15. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    16. Gonzalo Fernández-de-Córdoba & José Torres, 2011. "Forecasting the Spanish economy with an augmented VAR–DSGE model," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 2(3), pages 379-399, September.
    17. Schmidt, Sebastian & Wieland, Volker, 2013. "The New Keynesian Approach to Dynamic General Equilibrium Modeling: Models, Methods and Macroeconomic Policy Evaluation," Handbook of Computable General Equilibrium Modeling, in: Peter B. Dixon & Dale Jorgenson (ed.), Handbook of Computable General Equilibrium Modeling, edition 1, volume 1, chapter 0, pages 1439-1512, Elsevier.
    18. Giacomini, Raffaella, 2014. "Economic theory and forecasting: lessons from the literature," CEPR Discussion Papers 10201, C.E.P.R. Discussion Papers.
    19. Sun Xiaojin & Tsang Kwok Ping, 2019. "What cycles? Data detrending in DSGE models," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 23(3), pages 1-23, June.
    20. Del Negro, Marco & Eusepi, Stefano, 2011. "Fitting observed inflation expectations," Journal of Economic Dynamics and Control, Elsevier, vol. 35(12), pages 2105-2131.
    21. Federico Di Pace & Matthias Hertweck, 2019. "Labor Market Frictions, Monetary Policy, and Durable Goods," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 32, pages 274-304, April.

    More about this item

    Keywords

    Posterior predictive analysis; DSGE; Monetary Policy; Forecast Errors; Model Evaluation.;
    All these keywords.

    JEL classification:

    • E58 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit - - - Central Banks and Their Policies
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • E1 - Macroeconomics and Monetary Economics - - General Aggregative Models
    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:26718. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.