IDEAS home Printed from https://ideas.repec.org/a/jae/japmet/v25y2010i4p720-754.html
   My bibliography  Save this article

A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model

Author

Listed:
  • Rochelle M. Edge

    (Federal Reserve Board, Washington, DC, USA)

  • Michael T. Kiley

    (Federal Reserve Board, Washington, DC, USA)

  • Jean-Philippe Laforte

    (Federal Reserve Board, Washington, DC, USA)

Abstract

This paper considers the 'real-time' forecast performance of the Federal Reserve staff, time-series models, and an estimated dynamic stochastic general equilibrium (DSGE) model-the Federal Reserve Board's Estimated, Dynamic, Optimization-based (Edo) model. We evaluate forecast performance using out-of-sample predictions from 1996 to 2004. We find that the Edo model can provide forecasts that are competitive with those of Federal Reserve staff. Taken together with the fact that the Edo model has also proved useful in answering a range of policy questions, this suggests a significant and broad role for richly specified DSGE models in the toolbox of central bank models. Copyright © 2010 John Wiley & Sons, Ltd.

Suggested Citation

  • Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    • Handle: RePEc:jae:japmet:v:25:y:2010:i:4:p:720-754
    DOI: 10.1002/jae.1175
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1002/jae.1175
    File Function: Link to full text; subscription required
    Download Restriction: no
    File URL: http://qed.econ.queensu.ca:80/jae/2010-v25.4/
    File Function: Supporting data files and programs
    Download Restriction: no
    File URL: https://libkey.io/10.1002/jae.1175?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Athanasios Orphanides & Simon van Norden, 2002. "The Unreliability of Output-Gap Estimates in Real Time," The Review of Economics and Statistics, MIT Press, vol. 84(4), pages 569-583, November.
    2. Greenwood, Jeremy & Hercowitz, Zvi & Krusell, Per, 2000. "The role of investment-specific technological change in the business cycle," European Economic Review, Elsevier, vol. 44(1), pages 91-115, January.
    3. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    4. Marcellino, Massimiliano & Stock, James H. & Watson, Mark W., 2006. "A comparison of direct and iterated multistep AR methods for forecasting macroeconomic time series," Journal of Econometrics, Elsevier, vol. 135(1-2), pages 499-526.
    5. Jean-Philippe Laforte, 2007. "Pricing Models: A Bayesian DSGE Approach for the U.S. Economy," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 127-154, February.
    6. Malin Adolfson & Michael K. Andersson & Jesper Lindé & Mattias Villani & Anders Vredin, 2007. "Modern Forecasting Models in Action: Improving Macroeconomic Analyses at Central Banks," International Journal of Central Banking, International Journal of Central Banking, vol. 3(4), pages 111-144, December.
    7. Antonello D'Agostino & Domenico Giannone & Paolo Surico, 2005. "(Un)Predictability and Macroeconomic Stability," Macroeconomics 0510024, University Library of Munich, Germany.
    8. David Altig & Lawrence Christiano & Martin Eichenbaum & Jesper Linde, 2011. "Firm-Specific Capital, Nominal Rigidities and the Business Cycle," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(2), pages 225-247, April.
    9. Jordi Galí & Mark Gertler, 2007. "Macroeconomic Modeling for Monetary Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 21(4), pages 25-46, Fall.
    10. Faust, Jon & Wright, Jonathan H., 2009. "Comparing Greenbook and Reduced Form Forecasts Using a Large Realtime Dataset," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 468-479.
    11. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    12. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    13. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    14. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    15. Jeremy Rudd & Karl Whelan, 2007. "Modeling Inflation Dynamics: A Critical Review of Recent Research," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 155-170, February.
    16. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    17. David Altig & Lawrence Christiano & Martin Eichenbaum & Jesper Linde, 2011. "Firm-Specific Capital, Nominal Rigidities and the Business Cycle," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(2), pages 225-247, April.
    18. Michael T. Kiley, 2007. "A Quantitative Comparison of Sticky-Price and Sticky-Information Models of Price Setting," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 39(s1), pages 101-125, February.
    19. David L. Reifschneider & Peter Tulip, 2007. "Gauging the uncertainty of the economic outlook from historical forecasting errors," Finance and Economics Discussion Series 2007-60, Board of Governors of the Federal Reserve System (U.S.).
    20. Marta Bańbura, 2008. "Large Bayesian VARs," 2008 Meeting Papers 334, Society for Economic Dynamics.
    21. Sims, Christopher A., 2008. "Improving monetary policy models," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2460-2475, August.
    22. Kirdan Lees & Troy Matheson & Christie Smith, 2007. "Open Economy Dsge-Var Forecasting And Policy Analysis: Head To Head With The Rbnz Published Forecasts," CAMA Working Papers 2007-05, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    23. Whelan, Karl, 2003. "A Two-Sector Approach to Modeling U.S. NIPA Data," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 35(4), pages 627-656, August.
    24. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    25. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    26. Reifschneider, David L. & Stockton, David J. & Wilcox, David W., 1997. "Econometric models and the monetary policy process," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 47(1), pages 1-37, December.
    27. Mr. Tamim Bayoumi & Mr. Hamid Faruqee & Mr. Douglas Laxton & Mr. Philippe D Karam & Mr. Alessandro Rebucci & Mr. Jaewoo Lee & Mr. Benjamin L Hunt & Mr. Ivan Tchakarov, 2004. "GEM: A New International Macroeconomic Model," IMF Occasional Papers 2004/010, International Monetary Fund.
    28. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    29. Kadiyala, K Rao & Karlsson, Sune, 1997. "Numerical Methods for Estimation and Inference in Bayesian VAR-Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 12(2), pages 99-132, March-Apr.
    30. Edge, Rochelle M. & Kiley, Michael T. & Laforte, Jean-Philippe, 2008. "Natural rate measures in an estimated DSGE model of the U.S. economy," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2512-2535, August.
    31. Adolfson, Malin & Lindé, Jesper & Villani, Mattias, 2005. "Forecasting Performance of an Open Economy Dynamic Stochastic General Equilibrium Model," Working Paper Series 190, Sveriges Riksbank (Central Bank of Sweden), revised 01 Jun 2006.
    32. Brayton, Flint & Levin, Andrew & Lyon, Ralph & Williams, John C., 1997. "The evolution of macro models at the Federal Reserve Board," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 47(1), pages 43-81, December.
    33. Christopher J. Erceg & Luca Guerrieri & Christopher Gust, 2006. "SIGMA: A New Open Economy Model for Policy Analysis," International Journal of Central Banking, International Journal of Central Banking, vol. 2(1), March.
    34. Mark Gertler & Luca Sala & Antonella Trigari, 2008. "An Estimated Monetary DSGE Model with Unemployment and Staggered Nominal Wage Bargaining," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 40(8), pages 1713-1764, December.
    35. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    36. Anne B. Koehler & Emily S. Murphree, 1988. "A Comparison of the Akaike and Schwarz Criteria for Selecting Model Order," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 37(2), pages 187-195, June.
    37. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2007. "Documentation of the Research and Statistics Division’s estimated DSGE model of the U.S. economy: 2006 version," Finance and Economics Discussion Series 2007-53, Board of Governors of the Federal Reserve System (U.S.).
    38. Christopher A. Sims, 2002. "The Role of Models and Probabilities in the Monetary Policy Process," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 33(2), pages 1-62.
    39. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    40. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    41. David H. Romer & Christina D. Romer, 2000. "Federal Reserve Information and the Behavior of Interest Rates," American Economic Review, American Economic Association, vol. 90(3), pages 429-457, June.
    42. Robert J. Gordon, 1998. "Foundations of the Goldilocks Economy: Supply Shocks and the Time-Varying NAIRU," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 29(2), pages 297-346.
    43. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2005. "An estimated DSGE model of the US economy with an application to natural rate measures," Proceedings, Board of Governors of the Federal Reserve System (U.S.).
    44. Peter Tulip, 2005. "Has output become more predictable? changes in Greenbook forecast accuracy," Finance and Economics Discussion Series 2005-31, Board of Governors of the Federal Reserve System (U.S.).
    45. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    46. Fernandez-Villaverde, Jesus & Francisco Rubio-Ramirez, Juan, 2004. "Comparing dynamic equilibrium models to data: a Bayesian approach," Journal of Econometrics, Elsevier, vol. 123(1), pages 153-187, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2009. "A comparision of forecast, simple reduced-form models, and a DSGE model," CAMA Working Papers 2009-03, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
    2. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    3. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    4. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    5. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    6. Alessia Paccagnini, 2012. "Comparing Hybrid DSGE Models," Working Papers 228, University of Milano-Bicocca, Department of Economics, revised Dec 2012.
    7. Volker Wieland & Maik Wolters, 2011. "The diversity of forecasts from macroeconomic models of the US economy," Economic Theory, Springer;Society for the Advancement of Economic Theory (SAET), vol. 47(2), pages 247-292, June.
    8. Stelios Bekiros & Alessia Paccagnini, 2013. "On the predictability of time-varying VAR and DSGE models," Empirical Economics, Springer, vol. 45(1), pages 635-664, August.
    9. Thorvardur Tjörvi Ólafsson, 2006. "The New Keynesian Phillips Curve: In Search of Improvements and Adaptation to the Open Economy," Economics wp31_tjorvi, Department of Economics, Central bank of Iceland.
    10. Rochelle M. Edge & Refet S. Gurkaynak, 2010. "How Useful Are Estimated DSGE Model Forecasts for Central Bankers?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 41(2 (Fall)), pages 209-259.
    11. Michael T. Kiley & Jean-Philippe Laforte & Rochelle M. Edge, 2008. "The Sources of Fluctuations in Residential Investment: A View from a Policy-Oriented DSGE Model of the U.S. Economic," 2008 Meeting Papers 990, Society for Economic Dynamics.
    12. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    13. Andrea Carriero & Todd E. Clark & Massimiliano Marcellino, 2016. "Common Drifting Volatility in Large Bayesian VARs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 34(3), pages 375-390, July.
    14. Leeper, Eric M. & Plante, Michael & Traum, Nora, 2010. "Dynamics of fiscal financing in the United States," Journal of Econometrics, Elsevier, vol. 156(2), pages 304-321, June.
    15. Del Negro, Marco & Schorfheide, Frank, 2008. "Forming priors for DSGE models (and how it affects the assessment of nominal rigidities)," Journal of Monetary Economics, Elsevier, vol. 55(7), pages 1191-1208, October.
    16. Jesús Fernández-Villaverde, 2010. "The econometrics of DSGE models," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 1(1), pages 3-49, March.
    17. Rusnák, Marek, 2016. "Nowcasting Czech GDP in real time," Economic Modelling, Elsevier, vol. 54(C), pages 26-39.
    18. Rochelle M. Edge & Refet S. Gürkaynak, 2011. "How useful are estimated DSGE model forecasts?," Finance and Economics Discussion Series 2011-11, Board of Governors of the Federal Reserve System (U.S.).
    19. Thomai Filippeli & Konstantinos Theodoridis, 2015. "DSGE priors for BVAR models," Empirical Economics, Springer, vol. 48(2), pages 627-656, March.
    20. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jae:japmet:v:25:y:2010:i:4:p:720-754. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley-Blackwell Digital Licensing or Christopher F. Baum (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.