IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/2011-11.html
   My bibliography  Save this paper

How useful are estimated DSGE model forecasts?

Author

Abstract

DSGE models are a prominent tool for forecasting at central banks and the competitive forecasting performance of these models relative to alternatives--including official forecasts--has been documented. When evaluating DSGE models on an absolute basis, however, we find that the benchmark estimated medium scale DSGE model forecasts inflation and GDP growth very poorly, although statistical and judgmental forecasts forecast as poorly. Our finding is the DSGE model analogue of the literature documenting the recent poor performance of macroeconomic forecasts relative to simple naive forecasts since the onset of the Great Moderation. While this finding is broadly consistent with the DSGE model we employ--ie, the model itself implies that under strong monetary policy especially inflation deviations should be unpredictable--a \"wrong\" model may also have the same implication. We therefore argue that forecasting ability during the Great Moderation is not a good metric to judge the usefulness of model forecasts.

Suggested Citation

  • Rochelle M. Edge & Refet S. Gürkaynak, 2011. "How useful are estimated DSGE model forecasts?," Finance and Economics Discussion Series 2011-11, Board of Governors of the Federal Reserve System (U.S.).
  • Handle: RePEc:fip:fedgfe:2011-11
    as

    Download full text from publisher

    File URL: http://www.federalreserve.gov/pubs/feds/2011/201111/201111abs.html
    Download Restriction: no

    File URL: http://www.federalreserve.gov/pubs/feds/2011/201111/201111pap.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marvin Goodfriend & Robert G. King, 2013. "The Great Inflation Drift," NBER Chapters, in: The Great Inflation: The Rebirth of Modern Central Banking, pages 181-209, National Bureau of Economic Research, Inc.
    2. Jordi Galí & Frank Smets & Rafael Wouters, 2012. "Unemployment in an Estimated New Keynesian Model," NBER Macroeconomics Annual, University of Chicago Press, vol. 26(1), pages 329-360.
    3. Gurkaynak, Refet S. & Sack, Brian T. & Swanson, Eric P., 2007. "Market-Based Measures of Monetary Policy Expectations," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 201-212, April.
    4. Malin Adolfson & Michael K. Andersson & Jesper Lindé & Mattias Villani & Anders Vredin, 2007. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 111-144, December.
    5. Galí, Jordi, 2011. "Are central banks' projections meaningful?," Journal of Monetary Economics, Elsevier, vol. 58(6), pages 537-550.
    6. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    7. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    8. Calvo, Guillermo A., 1983. "Staggered prices in a utility-maximizing framework," Journal of Monetary Economics, Elsevier, vol. 12(3), pages 383-398, September.
    9. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    10. Kimball, Miles S, 1995. "The Quantitative Analytics of the Basic Neomonetarist Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 27(4), pages 1241-1277, November.
    11. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    12. Antonello D’ Agostino & Domenico Giannone, 2012. "Comparing Alternative Predictors Based on Large‐Panel Factor Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 306-326, April.
    13. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    14. Mattias Villani & Malin Adolfson & Jesper Linde, 2005. "Forecasting Performance of an Open Economy Dynamic Stochastic General Equilibrium Model," Money Macro and Finance (MMF) Research Group Conference 2005 32, Money Macro and Finance Research Group.
    15. James H. Stock & Mark W. Watson, 2010. "Modeling inflation after the crisis," Proceedings - Economic Policy Symposium - Jackson Hole, Federal Reserve Bank of Kansas City, pages 173-220.
    16. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    17. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    18. Kirdan Lees & Troy Matheson & Christie Smith, 2007. "Open economy DSGE-VAR forecasting and policy analysis - head to head with the RBNZ published forecasts," Reserve Bank of New Zealand Discussion Paper Series DP2007/01, Reserve Bank of New Zealand.
    19. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    20. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    21. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    22. Jeffrey C. Fuhrer & Giovanni P. Olivei & Geoffrey M. B. Tootell, 2009. "Empirical estimates of changing inflation dynamics," Working Papers 09-4, Federal Reserve Bank of Boston.
    23. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Blog mentions

    As found by EconAcademics.org, the blog aggregator for Economics research:
    1. Wall St shorts economists
      by Mark Buchanan in The Physics of Finance on 2014-02-14 19:27:00

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Boneva, Lena & Fawcett, Nicholas & Masolo, Riccardo M. & Waldron, Matt, 2019. "Forecasting the UK economy: Alternative forecasting methodologies and the role of off-model information," International Journal of Forecasting, Elsevier, vol. 35(1), pages 100-120.
    2. Alessia Paccagnini, 2012. "Comparing Hybrid DSGE Models," Working Papers 228, University of Milano-Bicocca, Department of Economics, revised Dec 2012.
    3. Galvão, Ana Beatriz, 2017. "Data revisions and DSGE models," Journal of Econometrics, Elsevier, vol. 196(1), pages 215-232.
    4. Garcés Díaz Daniel, 2016. "Changes in Inflation Predictability in Major Latin American Countries," Working Papers 2016-20, Banco de México.
    5. Carriero, Andrea & Galvão, Ana Beatriz & Kapetanios, George, 2019. "A comprehensive evaluation of macroeconomic forecasting methods," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1226-1239.
    6. Stelios Bekiros & Alessia Paccagnini, 2013. "On the predictability of time-varying VAR and DSGE models," Empirical Economics, Springer, vol. 45(1), pages 635-664, August.
    7. Cardani, Roberta & Paccagnini, Alessia & Villa, Stefania, 2019. "Forecasting with instabilities: An application to DSGE models with financial frictions," Journal of Macroeconomics, Elsevier, vol. 61(C), pages 1-1.
    8. Hasumi, Ryo & Iiboshi, Hirokuni & Matsumae, Tatsuyoshi & Nakamura, Daisuke, 2018. "Does a financial accelerator improve forecasts during financial crises?: Evidence from Japan with Prediction Pool Methods," MPRA Paper 85523, University Library of Munich, Germany.
    9. Kieran Mc Morrow & Werner Roeger & Valerie Vandermeulen, 2017. "Evaluating Medium Term Forecasting Methods and their Implications for EU Output Gap Calculations," European Economy - Discussion Papers 070, Directorate General Economic and Financial Affairs (DG ECFIN), European Commission.
    10. Douglas J. Crookes & Martin P. De Wit, 2014. "Is System Dynamics Modelling of Relevance to Neoclassical Economists?," South African Journal of Economics, Economic Society of South Africa, vol. 82(2), pages 181-192, June.
    11. Kapetanios, George & Price, Simon & Theodoridis, Konstantinos, 2015. "A new approach to multi-step forecasting using dynamic stochastic general equilibrium models," Economics Letters, Elsevier, vol. 136(C), pages 237-242.
    12. Carlos Benavides & Luis Gonzales & Manuel Diaz & Rodrigo Fuentes & Gonzalo García & Rodrigo Palma-Behnke & Catalina Ravizza, 2015. "The Impact of a Carbon Tax on the Chilean Electricity Generation Sector," Energies, MDPI, vol. 8(4), pages 1-27, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
    2. Wieland, Volker & Wolters, Maik, 2013. "Forecasting and Policy Making," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 239-325, Elsevier.
    3. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    4. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    5. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    6. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    7. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    8. Marcin Kolasa & Michał Rubaszek & Paweł Skrzypczyński, 2012. "Putting the New Keynesian DSGE Model to the Real‐Time Forecasting Test," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(7), pages 1301-1324, October.
    9. Lindé, J. & Smets, F. & Wouters, R., 2016. "Challenges for Central Banks’ Macro Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 2185-2262, Elsevier.
    10. João Valle e Azevedo & João Tovar Jalles, 2011. "Rational vs. Professional Forecasts," Working Papers w201114, Banco de Portugal, Economics and Research Department.
    11. Massimiliano Marcellino & Yuliya Rychalovska, 2012. "An estimated DSGE model of a Small Open Economy within the Monetary Union: Forecasting and Structural Analysis," RSCAS Working Papers 2012/34, European University Institute.
    12. Schorfheide, Frank & Sill, Keith & Kryshko, Maxym, 2010. "DSGE model-based forecasting of non-modelled variables," International Journal of Forecasting, Elsevier, vol. 26(2), pages 348-373, April.
    13. Massimiliano Marcellino & Yuliya Rychalovska, 2014. "Forecasting with a DSGE Model of a Small Open Economy within the Monetary Union," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(5), pages 315-338, August.
    14. Cai, Michael & Del Negro, Marco & Giannoni, Marc P. & Gupta, Abhi & Li, Pearl & Moszkowski, Erica, 2019. "DSGE forecasts of the lost recovery," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1770-1789.
    15. Luca Sala & Ulf Söderström & Antonella Trigari, 2013. "Structural and Cyclical Forces in the Labor Market during the Great Recession: Cross-Country Evidence," NBER International Seminar on Macroeconomics, University of Chicago Press, vol. 9(1), pages 345-404.
    16. Ana Beatriz Galvão & Liudas Giraitis & George Kapetanios & Katerina Petrova, 2015. "A Bayesian Local Likelihood Method for Modelling Parameter Time Variation in DSGE Models," Working Papers 770, Queen Mary University of London, School of Economics and Finance.
    17. Paul Hubert, 2015. "Revisiting the Greenbook’s relative forecasting performance," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(1), pages 151-179.
    18. Corbo, Vesna & Strid, Ingvar, 2020. "MAJA: A two-region DSGE model for Sweden and its main trading partners," Working Paper Series 391, Sveriges Riksbank (Central Bank of Sweden).
    19. Patrick F»Ve & Julien Matheron & Jean-Guillaume Sahuc, 2010. "Disinflation Shocks in the Eurozone: A DSGE Perspective," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 42(2-3), pages 289-323, March.
    20. Gbaguidi DAVID, 2011. "Expectations Impact On The Effectiveness Of The Inflation-Real Activity Trade-Off," Theoretical and Practical Research in the Economic Fields, ASERS Publishing, vol. 2(2), pages 141-181.

    More about this item

    Keywords

    Economic forecasting; Inflation (Finance); Econometric models;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:2011-11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.