IDEAS home Printed from https://ideas.repec.org/p/ecb/ecbwps/20101185.html
   My bibliography  Save this paper

Forecasting with DSGE models

Author

Listed:
  • Warne, Anders
  • Coenen, Günter
  • Christoffel, Kai

Abstract

In this paper we review the methodology of forecasting with log-linearised DSGE models using Bayesian methods. We focus on the estimation of their predictive distributions, with special attention being paid to the mean and the covariance matrix of h-step ahead forecasts. In the empirical analysis, we examine the forecasting performance of the New Area-Wide Model (NAWM) that has been designed for use in the macroeconomic projections at the European Central Bank. The forecast sample covers the period following the introduction of the euro and the out-of-sample performance of the NAWM is compared to nonstructural benchmarks, such as Bayesian vector autoregressions (BVARs). Overall, the empirical evidence indicates that the NAWM compares quite well with the reduced-form models and the results are therefore in line with previous studies. Yet there is scope for improving the NAWM’s forecasting performance. For example, the model is not able to explain the moderation in wage growth over the forecast evaluation period and, therefore, it tends to overestimate nominal wages. As a consequence, both the multivariate point and density forecasts using the log determinant and the log predictive score, respectively, suggest that a large BVAR can outperform the NAWM. JEL Classification: C11, C32, E32, E37

Suggested Citation

  • Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
  • Handle: RePEc:ecb:ecbwps:20101185
    Note: 563011
    as

    Download full text from publisher

    File URL: https://www.ecb.europa.eu//pub/pdf/scpwps/ecbwp1185.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Malin Adolfson & Jesper Linde & Mattias Villani, 2007. "Forecasting Performance of an Open Economy DSGE Model," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 289-328.
    2. Marco Del Negro & Frank Schorfheide, 2006. "How good is what you've got? DSGE-VAR as a toolkit for evaluating DSGE models," Economic Review, Federal Reserve Bank of Atlanta, vol. 91(Q 2), pages 21-37.
    3. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Thomas J. Sargent & Mark W. Watson, 2007. "ABCs (and Ds) of Understanding VARs," American Economic Review, American Economic Association, vol. 97(3), pages 1021-1026, June.
    4. Marta Bańbura, 2008. "Large Bayesian VARs," 2008 Meeting Papers 334, Society for Economic Dynamics.
    5. Christiano, Lawrence J. & Trabandt, Mathias & Walentin, Karl, 2011. "Introducing financial frictions and unemployment into a small open economy model," Journal of Economic Dynamics and Control, Elsevier, vol. 35(12), pages 1999-2041.
    6. Mu-Chun Wang, 2009. "Comparing the DSGE model with the factor model: an out-of-sample forecasting experiment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 28(2), pages 167-182.
    7. Jordi Galí & Mark Gertler, 2007. "Macroeconomic Modeling for Monetary Policy Evaluation," Journal of Economic Perspectives, American Economic Association, vol. 21(4), pages 25-46, Fall.
    8. Lees, Kirdan & Matheson, Troy & Smith, Christie, 2011. "Open economy forecasting with a DSGE-VAR: Head to head with the RBNZ published forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 512-528.
    9. N. G. Mankiw, 2009. "The Macroeconomist as Scientist and Engineer," Voprosy Ekonomiki, NP Voprosy Ekonomiki, issue 5.
    10. Clements, Michael P. & Smith, Jeremy, 1998. "Evaluating The Forecast Densities Of Linear And Non-Linear Models: Applications To Output Growth And Unemployment," Economic Research Papers 268791, University of Warwick - Department of Economics.
    11. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    12. Ghent, Andra C., 2009. "Comparing DSGE-VAR forecasting models: How big are the differences?," Journal of Economic Dynamics and Control, Elsevier, vol. 33(4), pages 864-882, April.
    13. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    14. Adolfson, Malin & Laseen, Stefan & Linde, Jesper & Villani, Mattias, 2007. "Bayesian estimation of an open economy DSGE model with incomplete pass-through," Journal of International Economics, Elsevier, vol. 72(2), pages 481-511, July.
    15. Hansen, Lars Peter & Sargent, Thomas J., 1980. "Formulating and estimating dynamic linear rational expectations models," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 7-46, May.
    16. Marco Del Negro & Frank Schorfheide, 2009. "Monetary Policy Analysis with Potentially Misspecified Models," American Economic Review, American Economic Association, vol. 99(4), pages 1415-1450, September.
    17. Kydland, Finn E & Prescott, Edward C, 1982. "Time to Build and Aggregate Fluctuations," Econometrica, Econometric Society, vol. 50(6), pages 1345-1370, November.
    18. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    19. Francis X. Diebold & Anthony S. Tay & Kenneth F. Wallis, 1997. "Evaluating Density Forecasts of Inflation: The Survey of Professional Forecasters," NBER Working Papers 6228, National Bureau of Economic Research, Inc.
    20. Juan F. Rubio-Ramirez & Jesus Fernández-Villaverde, 2005. "Estimating dynamic equilibrium economies: linear versus nonlinear likelihood," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 20(7), pages 891-910.
    21. Thomas Doan & Robert B. Litterman & Christopher A. Sims, 1983. "Forecasting and Conditional Projection Using Realistic Prior Distributions," NBER Working Papers 1202, National Bureau of Economic Research, Inc.
    22. John F. Henry & L. Randall Wray, 1998. "Economic Time," Macroeconomics 9811004, University Library of Munich, Germany.
    23. Anderson, Gary S., 2010. "A reliable and computationally efficient algorithm for imposing the saddle point property in dynamic models," Journal of Economic Dynamics and Control, Elsevier, vol. 34(3), pages 472-489, March.
    24. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    25. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    26. Sims, Christopher A, 1980. "Macroeconomics and Reality," Econometrica, Econometric Society, vol. 48(1), pages 1-48, January.
    27. Francis X. Diebold, 1998. "The Past, Present, and Future of Macroeconomic Forecasting," Journal of Economic Perspectives, American Economic Association, vol. 12(2), pages 175-192, Spring.
    28. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    29. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    30. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    31. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    32. Lawrence J. Christiano & Martin Eichenbaum & Charles L. Evans, 2005. "Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy," Journal of Political Economy, University of Chicago Press, vol. 113(1), pages 1-45, February.
    33. Blanchard, Olivier Jean & Kahn, Charles M, 1980. "The Solution of Linear Difference Models under Rational Expectations," Econometrica, Econometric Society, vol. 48(5), pages 1305-1311, July.
    34. Geweke, John & Amisano, Gianni, 2011. "Optimal prediction pools," Journal of Econometrics, Elsevier, vol. 164(1), pages 130-141, September.
    35. Anderson, Gary & Moore, George, 1985. "A linear algebraic procedure for solving linear perfect foresight models," Economics Letters, Elsevier, vol. 17(3), pages 247-252.
    36. Rochelle M. Edge & Michael T. Kiley & Jean-Philippe Laforte, 2010. "A comparison of forecast performance between Federal Reserve staff forecasts, simple reduced-form models, and a DSGE model," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 720-754.
    37. Adolfson, Malin & Laséen, Stefan & Lindé, Jesper & Villani, Mattias, 2008. "Evaluating an estimated new Keynesian small open economy model," Journal of Economic Dynamics and Control, Elsevier, vol. 32(8), pages 2690-2721, August.
    38. Granger,Clive W. J., 1999. "Empirical Modeling in Economics," Cambridge Books, Cambridge University Press, number 9780521662086.
    39. Chib S. & Jeliazkov I., 2001. "Marginal Likelihood From the Metropolis-Hastings Output," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 270-281, March.
    40. Marco Del Negro & Frank Schorfheide, 2004. "Priors from General Equilibrium Models for VARS," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 45(2), pages 643-673, May.
    41. Bauwens, Luc & Lubrano, Michel & Richard, Jean-Francois, 2000. "Bayesian Inference in Dynamic Econometric Models," OUP Catalogue, Oxford University Press, number 9780198773139.
    42. Sims, Christopher A & Zha, Tao, 1998. "Bayesian Methods for Dynamic Multivariate Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 949-968, November.
    43. Villani, Mattias, 2001. "Bayesian prediction with cointegrated vector autoregressions," International Journal of Forecasting, Elsevier, vol. 17(4), pages 585-605.
    44. Ingram, Beth F. & Whiteman, Charles H., 1994. "Supplanting the 'Minnesota' prior: Forecasting macroeconomic time series using real business cycle model priors," Journal of Monetary Economics, Elsevier, vol. 34(3), pages 497-510, December.
    45. Calvo, Guillermo A., 1983. "Staggered prices in a utility-maximizing framework," Journal of Monetary Economics, Elsevier, vol. 12(3), pages 383-398, September.
    46. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    47. Klein, Paul, 2000. "Using the generalized Schur form to solve a multivariate linear rational expectations model," Journal of Economic Dynamics and Control, Elsevier, vol. 24(10), pages 1405-1423, September.
    48. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    49. Thompson, Patrick A & Miller, Robert B, 1986. "Sampling the Future: A Bayesian Approach to Forecasting from Univariate Time Series Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(4), pages 427-436, October.
    50. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    51. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    52. Thomas Lubik & Frank Schorfheide, 2006. "A Bayesian Look at New Open Economy Macroeconomics," NBER Chapters, in: NBER Macroeconomics Annual 2005, Volume 20, pages 313-382, National Bureau of Economic Research, Inc.
    53. Litterman, Robert B, 1986. "Forecasting with Bayesian Vector Autoregressions-Five Years of Experience," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(1), pages 25-38, January.
    54. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
    55. Tilmann Gneiting & Fadoua Balabdaoui & Adrian E. Raftery, 2007. "Probabilistic forecasts, calibration and sharpness," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 243-268, April.
    56. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    57. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    58. Stock, James H & Watson, Mark W, 2002. "Macroeconomic Forecasting Using Diffusion Indexes," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(2), pages 147-162, April.
    59. John C. Robertson & Ellis W. Tallman, 1999. "Vector autoregressions: forecasting and reality," Economic Review, Federal Reserve Bank of Atlanta, vol. 84(Q1), pages 4-18.
    60. Kadiyala, K Rao & Karlsson, Sune, 1997. "Numerical Methods for Estimation and Inference in Bayesian VAR-Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 12(2), pages 99-132, March-Apr.
    61. Sargent, Thomas J, 1989. "Two Models of Measurements and the Investment Accelerator," Journal of Political Economy, University of Chicago Press, vol. 97(2), pages 251-287, April.
    62. Rubaszek, Michal & Skrzypczynski, Pawel, 2008. "On the forecasting performance of a small-scale DSGE model," International Journal of Forecasting, Elsevier, vol. 24(3), pages 498-512.
    63. Mattias Villani, 2009. "Steady-state priors for vector autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 630-650.
    64. Litterman, Robert, 1986. "Forecasting with Bayesian vector autoregressions -- Five years of experience : Robert B. Litterman, Journal of Business and Economic Statistics 4 (1986) 25-38," International Journal of Forecasting, Elsevier, vol. 2(4), pages 497-498.
    65. Fagan, Gabriel & Henry, Jerome & Mestre, Ricardo, 2005. "An area-wide model for the euro area," Economic Modelling, Elsevier, vol. 22(1), pages 39-59, January.
    66. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    67. Andrew Atkeson & Lee E. Ohanian, 2001. "Are Phillips curves useful for forecasting inflation?," Quarterly Review, Federal Reserve Bank of Minneapolis, vol. 25(Win), pages 2-11.
    68. R. J. Cameron, 1957. "Comment," The Economic Record, The Economic Society of Australia, vol. 33(65), pages 261-264, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    2. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    3. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2013. "Predictive likelihood comparisons with DSGE and DSGE-VAR models," Working Paper Series 1536, European Central Bank.
    4. Alessia Paccagnini, 2012. "Comparing Hybrid DSGE Models," Working Papers 228, University of Milano-Bicocca, Department of Economics, revised Dec 2012.
    5. Stelios Bekiros & Alessia Paccagnini, 2013. "On the predictability of time-varying VAR and DSGE models," Empirical Economics, Springer, vol. 45(1), pages 635-664, August.
    6. Anders Warne & Günter Coenen & Kai Christoffel, 2017. "Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE, DSGE‐VAR, and VAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 103-119, January.
    7. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    8. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.
    9. Stelios D. Bekiros & Alessia Paccagnini, 2016. "Policy‐Oriented Macroeconomic Forecasting with Hybrid DGSE and Time‐Varying Parameter VAR Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(7), pages 613-632, November.
    10. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    11. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    12. Marcin Kolasa & Michał Rubaszek & Paweł Skrzypczyński, 2012. "Putting the New Keynesian DSGE Model to the Real‐Time Forecasting Test," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 44(7), pages 1301-1324, October.
    13. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    14. Gonzalo Fernández-de-Córdoba & José Torres, 2011. "Forecasting the Spanish economy with an augmented VAR–DSGE model," SERIEs: Journal of the Spanish Economic Association, Springer;Spanish Economic Association, vol. 2(3), pages 379-399, September.
    15. Carlo A. Favero, 2009. "The Econometrics of Monetary Policy: An Overview," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 16, pages 821-850, Palgrave Macmillan.
    16. Adnan Haider Bukhari & Safdar Ullah Khan, 2008. "A Small Open Economy DSGE Model for Pakistan," The Pakistan Development Review, Pakistan Institute of Development Economics, vol. 47(4), pages 963-1008.
    17. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2015. "Prior Selection for Vector Autoregressions," The Review of Economics and Statistics, MIT Press, vol. 97(2), pages 436-451, May.
    18. Karlsson, Sune, 2013. "Forecasting with Bayesian Vector Autoregression," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 791-897, Elsevier.
    19. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    20. Henzel, Steffen R. & Mayr, Johannes, 2013. "The mechanics of VAR forecast pooling—A DSGE model based Monte Carlo study," The North American Journal of Economics and Finance, Elsevier, vol. 24(C), pages 1-24.

    More about this item

    Keywords

    Bayesian inference; DSGE models; euro area; forecasting; open-economy macroeconomics; vector autoregression;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • E32 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Business Fluctuations; Cycles
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20101185. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Official Publications (email available below). General contact details of provider: https://edirc.repec.org/data/emieude.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.