IDEAS home Printed from https://ideas.repec.org/a/bin/bpeajo/v41y2010i2010-02p209-259.html
   My bibliography  Save this article

How Useful Are Estimated DSGE Model Forecasts for Central Bankers?

Author

Listed:
  • Rochelle M. Edge

    (Board of Governors of the Federal Reserve System)

  • Refet S. Gurkaynak

    (Bilkent University)

Abstract

DSGE models are a prominent tool for forecasting at central banks and the competitive forecasting performance of these models relative to alternatives--including official forecasts--has been documented. When evaluating DSGE models on an absolute basis, however, we find that the benchmark estimated medium scale DSGE model forecasts inflation and GDP growth very poorly, although statistical and judgmental forecasts forecast as poorly. Our finding is the DSGE model analogue of the literature documenting the recent poor performance of macroeconomic forecasts relative to simple naive forecasts since the onset of the Great Moderation. While this finding is broadly consistent with the DSGE model we employ--ie, the model itself implies that under strong monetary policy especially inflation deviations should be unpredictable--a 'wrong' model may also have the same implication. We therefore argue that forecasting ability during the Great Moderation is not a good metric to judge models.
(This abstract was borrowed from another version of this item.)

Suggested Citation

  • Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
  • Handle: RePEc:bin:bpeajo:v:41:y:2010:i:2010-02:p:209-259
    as

    Download full text from publisher

    File URL: https://www.brookings.edu/wp-content/uploads/2010/09/2010b_bpea_edge.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Kirdan Lees & Troy Matheson & Christie Smith, 2007. "Open economy DSGE-VAR forecasting and policy analysis - head to head with the RBNZ published forecasts," Reserve Bank of New Zealand Discussion Paper Series DP2007/01, Reserve Bank of New Zealand.
    2. Gurkaynak, Refet S. & Sack, Brian T. & Swanson, Eric P., 2007. "Market-Based Measures of Monetary Policy Expectations," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 201-212, April.
    3. Marvin Goodfriend & Robert G. King, 2013. "The Great Inflation Drift," NBER Chapters, in: The Great Inflation: The Rebirth of Modern Central Banking, pages 181-209, National Bureau of Economic Research, Inc.
    4. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    5. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    6. Refet Gürkaynak & Justin Wolfers, 2005. "Macroeconomic Derivatives: An Initial Analysis of Market-Based Macro Forecasts, Uncertainty, and Risk," NBER Chapters, in: NBER International Seminar on Macroeconomics 2005, pages 11-50, National Bureau of Economic Research, Inc.
    7. Jordi Galí & Frank Smets & Rafael Wouters, 2012. "Unemployment in an Estimated New Keynesian Model," NBER Macroeconomics Annual, University of Chicago Press, vol. 26(1), pages 329-360.
    8. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    9. Kimball, Miles S, 1995. "The Quantitative Analytics of the Basic Neomonetarist Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 27(4), pages 1241-1277, November.
    10. Bharat Trehan, 2015. "Survey Measures of Expected Inflation and the Inflation Process," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(1), pages 207-222, February.
    11. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    12. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    13. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    14. John P. Judd & Bharat Trehan, 1992. "Money, credit, and M2," FRBSF Economic Letter, Federal Reserve Bank of San Francisco, issue sep4.
    15. Antonello D’ Agostino & Domenico Giannone, 2012. "Comparing Alternative Predictors Based on Large‐Panel Factor Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(2), pages 306-326, April.
    16. James H. Stock & Mark W. Watson, 2007. "Why Has U.S. Inflation Become Harder to Forecast?," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 3-33, February.
    17. Olivier Blanchard & Jordi Galí, 2007. "Real Wage Rigidities and the New Keynesian Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 35-65, February.
    18. Malin Adolfson & Michael K. Andersson & Jesper Lindé & Mattias Villani & Anders Vredin, 2007. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 111-144, December.
    19. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, University Library of Munich, Germany.
    20. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    21. Peter Tulip, 2009. "Has the Economy Become More Predictable? Changes in Greenbook Forecast Accuracy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(6), pages 1217-1231, September.
    22. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    23. Jeffrey C. Fuhrer & Giovanni P. Olivei & Geoffrey M. B. Tootell, 2009. "Empirical estimates of changing inflation dynamics," Working Papers 09-4, Federal Reserve Bank of Boston.
    24. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    25. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    26. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    27. Calvo, Guillermo A., 1983. "Staggered prices in a utility-maximizing framework," Journal of Monetary Economics, Elsevier, vol. 12(3), pages 383-398, September.
    28. King, Robert G. & Plosser, Charles I. & Rebelo, Sergio T., 1988. "Production, growth and business cycles : I. The basic neoclassical model," Journal of Monetary Economics, Elsevier, vol. 21(2-3), pages 195-232.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rochelle M. Edge & Refet S. Gürkaynak, 2011. "How useful are estimated DSGE model forecasts?," Finance and Economics Discussion Series 2011-11, Board of Governors of the Federal Reserve System (U.S.).
    2. Wieland, Volker & Wolters, Maik, 2013. "Forecasting and Policy Making," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 239-325, Elsevier.
    3. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    4. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    5. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    6. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    7. Paul Hubert, 2015. "Revisiting the Greenbook’s relative forecasting performance," Revue de l'OFCE, Presses de Sciences-Po, vol. 0(1), pages 151-179.
    8. Paul Hubert, 2015. "Do Central Bank Forecasts Influence Private Agents? Forecasting Performance versus Signals," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 47(4), pages 771-789, June.
    9. Negro, Marco Del & Schorfheide, Frank, 2013. "DSGE Model-Based Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 57-140, Elsevier.
    10. repec:hal:spmain:info:hdl:2441/35kgubh40v9gfpnuruelqjnptb is not listed on IDEAS
    11. Alexander Mihailov & Giovanni Razzu & Zhe Wang, 2019. "Heterogeneous effects of single monetary policy on unemployment rates in the largest EMU economies," Economics Discussion Papers em-dp2019-07, Department of Economics, University of Reading.
    12. Cai, Michael & Del Negro, Marco & Giannoni, Marc P. & Gupta, Abhi & Li, Pearl & Moszkowski, Erica, 2019. "DSGE forecasts of the lost recovery," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1770-1789.
    13. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    14. Roberto Duncan & Enrique Martínez‐García, 2023. "Forecasting inflation in open economies: What can a NOEM model do?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(3), pages 481-513, April.
    15. Ana Beatriz Galvão & Liudas Giraitis & George Kapetanios & Katerina Petrova, 2015. "A Bayesian Local Likelihood Method for Modelling Parameter Time Variation in DSGE Models," Working Papers 770, Queen Mary University of London, School of Economics and Finance.
    16. Marcin Kolasa & Michał Rubaszek & Paweł Skrzypczyński, 2012. "Putting the New Keynesian DSGE Model to the Real‐Time Forecasting Test," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(7), pages 1301-1324, October.
    17. Gamber, Edward N. & Smith, Julie K., 2009. "Are the Fed's inflation forecasts still superior to the private sector's?," Journal of Macroeconomics, Elsevier, vol. 31(2), pages 240-251, June.
    18. Lindé, J. & Smets, F. & Wouters, R., 2016. "Challenges for Central Banks’ Macro Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 2185-2262, Elsevier.
    19. Gbaguidi DAVID, 2011. "Expectations Impact On The Effectiveness Of The Inflation-Real Activity Trade-Off," Theoretical and Practical Research in the Economic Fields, ASERS Publishing, vol. 2(2), pages 141-181.
    20. João Valle e Azevedo & João Tovar Jalles, 2011. "Rational vs. Professional Forecasts," Working Papers w201114, Banco de Portugal, Economics and Research Department.
    21. Ippei Fujiwara & Yasuo Hirose, 2014. "Indeterminacy and Forecastability," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 46(1), pages 243-251, February.

    More about this item

    Keywords

    bank; banker; DSGE; forecast; macroeconomic;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C54 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Quantitative Policy Modeling
    • E47 - Macroeconomics and Monetary Economics - - Money and Interest Rates - - - Forecasting and Simulation: Models and Applications

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bin:bpeajo:v:41:y:2010:i:2010-02:p:209-259. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Haowen Chen (email available below). General contact details of provider: https://edirc.repec.org/data/esbrous.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.