IDEAS home Printed from https://ideas.repec.org/p/ecb/ecbwps/20131536.html
   My bibliography  Save this paper

Predictive likelihood comparisons with DSGE and DSGE-VAR models

Author

Listed:
  • Warne, Anders
  • Coenen, Günter
  • Christoffel, Kai

Abstract

This paper shows how to compute the h-step-ahead predictive likelihood for any subset of the observed variables in parametric discrete time series models estimated with Bayesian methods. The subset of variables may vary across forecast horizons and the problem thereby covers marginal and joint predictive likelihoods for a fixed subset as special cases. The basic idea is to utilize well-known techniques for handling missing data when computing the likelihood function, such as a missing observations consistent Kalman filter for linear Gaussian models, but it also extends to nonlinear, nonnormal state-space models. The predictive likelihood can thereafter be calculated via Monte Carlo integration using draws from the posterior distribution. As an empirical illustration, we use euro area data and compare the forecasting performance of the New Area-Wide Model, a small-open-economy DSGE model, to DSGEVARs, and to reduced-form linear Gaussian models. JEL Classification: C11, C32, C52, C53, E37

Suggested Citation

  • Warne, Anders & Coenen, Günter & Christoffel, Kai, 2013. "Predictive likelihood comparisons with DSGE and DSGE-VAR models," Working Paper Series 1536, European Central Bank.
  • Handle: RePEc:ecb:ecbwps:20131536
    Note: 563011
    as

    Download full text from publisher

    File URL: https://www.ecb.europa.eu//pub/pdf/scpwps/ecbwp1536.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Thomas J. Sargent & Mark W. Watson, 2007. "ABCs (and Ds) of Understanding VARs," American Economic Review, American Economic Association, vol. 97(3), pages 1021-1026, June.
    2. Lees, Kirdan & Matheson, Troy & Smith, Christie, 2011. "Open economy forecasting with a DSGE-VAR: Head to head with the RBNZ published forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 512-528.
    3. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2008. "The new area-wide model of the euro area: a micro-founded open-economy model for forecasting and policy analysis," Working Paper Series 944, European Central Bank.
    4. Geweke, John & Amisano, Gianni, 2010. "Comparing and evaluating Bayesian predictive distributions of asset returns," International Journal of Forecasting, Elsevier, vol. 26(2), pages 216-230, April.
    5. John F. Henry & L. Randall Wray, 1998. "Economic Time," Macroeconomics 9811004, University Library of Munich, Germany.
    6. John Geweke, 1999. "Using simulation methods for bayesian econometric models: inference, development,and communication," Econometric Reviews, Taylor & Francis Journals, vol. 18(1), pages 1-73.
    7. Ravenna, Federico, 2007. "Vector autoregressions and reduced form representations of DSGE models," Journal of Monetary Economics, Elsevier, vol. 54(7), pages 2048-2064, October.
    8. Joshua C. C. Chan & Eric Eisenstat, 2015. "Marginal Likelihood Estimation with the Cross-Entropy Method," Econometric Reviews, Taylor & Francis Journals, vol. 34(3), pages 256-285, March.
    9. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    10. John Geweke & Gianni Amisano, 2012. "Prediction with Misspecified Models," American Economic Review, American Economic Association, vol. 102(3), pages 482-486, May.
    11. Geweke, John & Amisano, Gianni, 2011. "Optimal prediction pools," Journal of Econometrics, Elsevier, vol. 164(1), pages 130-141, September.
    12. Rodney W. Strachan & Herman K. van Dijk, 2014. "Divergent Priors and Well Behaved Bayes Factors," Central European Journal of Economic Modelling and Econometrics, Central European Journal of Economic Modelling and Econometrics, vol. 6(1), pages 1-31, March.
    13. Marta Banbura & Domenico Giannone & Lucrezia Reichlin, 2010. "Large Bayesian vector auto regressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 71-92.
    14. Massimo Franchi & Paolo Paruolo, 2012. "On ABCs (and Ds) of VAR representations of DSGE models," Working Paper series 56_12, Rimini Centre for Economic Analysis, revised Aug 2012.
    15. Negro, Marco Del & Schorfheide, Frank, 2013. "DSGE Model-Based Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 57-140, Elsevier.
    16. Ingram, Beth F. & Whiteman, Charles H., 1994. "Supplanting the 'Minnesota' prior: Forecasting macroeconomic time series using real business cycle model priors," Journal of Monetary Economics, Elsevier, vol. 34(3), pages 497-510, December.
    17. Calvo, Guillermo A., 1983. "Staggered prices in a utility-maximizing framework," Journal of Monetary Economics, Elsevier, vol. 12(3), pages 383-398, September.
    18. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    19. Frank Smets & Rafael Wouters, 2007. "Shocks and Frictions in US Business Cycles: A Bayesian DSGE Approach," American Economic Review, American Economic Association, vol. 97(3), pages 586-606, June.
    20. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    21. Anthony Tay & Kenneth F. Wallis, 2000. "Density Forecasting: A Survey," Econometric Society World Congress 2000 Contributed Papers 0370, Econometric Society.
    22. John Geweke, 1999. "Using Simulation Methods for Bayesian Econometric Models," Computing in Economics and Finance 1999 832, Society for Computational Economics.
    23. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    24. Sims, Christopher A, 2002. "Solving Linear Rational Expectations Models," Computational Economics, Springer;Society for Computational Economics, vol. 20(1-2), pages 1-20, October.
    25. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178.
    26. Malin Adolfson & Jesper Linde & Mattias Villani, 2007. "Forecasting Performance of an Open Economy DSGE Model," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 289-328.
    27. Marta Bańbura, 2008. "Large Bayesian VARs," 2008 Meeting Papers 334, Society for Economic Dynamics.
    28. Sims, Christopher A. & Waggoner, Daniel F. & Zha, Tao, 2008. "Methods for inference in large multiple-equation Markov-switching models," Journal of Econometrics, Elsevier, vol. 146(2), pages 255-274, October.
    29. Anderson, Gary S., 2010. "A reliable and computationally efficient algorithm for imposing the saddle point property in dynamic models," Journal of Economic Dynamics and Control, Elsevier, vol. 34(3), pages 472-489, March.
    30. Jana Eklund & Sune Karlsson, 2007. "Forecast Combination and Model Averaging Using Predictive Measures," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 329-363.
    31. Villani, Mattias, 2001. "Bayesian prediction with cointegrated vector autoregressions," International Journal of Forecasting, Elsevier, vol. 17(4), pages 585-605.
    32. Klein, Paul, 2000. "Using the generalized Schur form to solve a multivariate linear rational expectations model," Journal of Economic Dynamics and Control, Elsevier, vol. 24(10), pages 1405-1423, September.
    33. Thompson, Patrick A & Miller, Robert B, 1986. "Sampling the Future: A Bayesian Approach to Forecasting from Univariate Time Series Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 4(4), pages 427-436, October.
    34. Thomas Lubik & Frank Schorfheide, 2006. "A Bayesian Look at New Open Economy Macroeconomics," NBER Chapters, in: NBER Macroeconomics Annual 2005, Volume 20, pages 313-382, National Bureau of Economic Research, Inc.
    35. Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
    36. Fagan, Gabriel & Henry, Jerome & Mestre, Ricardo, 2005. "An area-wide model for the euro area," Economic Modelling, Elsevier, vol. 22(1), pages 39-59, January.
    37. Frank Smets & Raf Wouters, 2003. "An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association, MIT Press, vol. 1(5), pages 1123-1175, September.
    38. Dieppe, Alistair & Warmedinger, Thomas, 2007. "Modelling intra- and extra-area trade substitution and exchange rate pass-through in the euro area," Working Paper Series 760, European Central Bank.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pelin Ilbas & Øistein Røisland & Tommy Sveen, 2013. "The influence of the Taylor rule on US monetary policy," Working Paper 2013/04, Norges Bank.
    2. Patrick Fève & Jean‐Guillaume Sahuc, 2017. "In Search of the Transmission Mechanism of Fiscal Policy in the Euro Area," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(3), pages 704-718, April.
    3. Anders Warne & Günter Coenen & Kai Christoffel, 2017. "Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE, DSGE‐VAR, and VAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 103-119, January.
    4. Boris Blagov, 2018. "Financial crises and time-varying risk premia in a small open economy: a Markov-switching DSGE model for Estonia," Empirical Economics, Springer, vol. 54(3), pages 1017-1060, May.
    5. Negro, Marco Del & Schorfheide, Frank, 2013. "DSGE Model-Based Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 57-140, Elsevier.
    6. Konstantinos Theodoridis & Francesco Zanetti, 2016. "News shocks and labour market dynamics in matching models," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 49(3), pages 906-930, August.
    7. Smets, Frank & Warne, Anders & Wouters, Rafael, 2014. "Professional forecasters and real-time forecasting with a DSGE model," International Journal of Forecasting, Elsevier, vol. 30(4), pages 981-995.
    8. Francesco Simone Lucidi, 2023. "The misalignment of fiscal multipliers in Italian regions," Regional Studies, Taylor & Francis Journals, vol. 57(10), pages 2073-2086, October.
    9. Erlan Konebayev, 2023. "Forecasting a Commodity-Exporting Small Open Developing Economy Using DSGE and DSGE-BVAR," International Economic Journal, Taylor & Francis Journals, vol. 37(1), pages 39-70, January.
    10. Markku Lanne & Jani Luoto, 2015. "Estimation of DSGE Models under Diffuse Priors and Data-Driven Identification Constraints," CREATES Research Papers 2015-37, Department of Economics and Business Economics, Aarhus University.
    11. Tomáš Jeřábek & Radka Šperková, 2015. "A Predictive Likelihood Approach to Bayesian Averaging," Acta Universitatis Agriculturae et Silviculturae Mendelianae Brunensis, Mendel University Press, vol. 63(4), pages 1269-1276.
    12. Smets, Frank & Warne, Anders & Wouters, Raf, 2013. "Professional forecasters and the real-time forecasting performance of an estimated new keynesian model for the euro area," Working Paper Series 1571, European Central Bank.
    13. Pop, Raluca-Elena, 2017. "A small-scale DSGE-VAR model for the Romanian economy," Economic Modelling, Elsevier, vol. 67(C), pages 1-9.
    14. Michal Andrle & Mr. Benjamin L Hunt, 2020. "Model-Based Globally-Consistent Risk Assessment," IMF Working Papers 2020/064, International Monetary Fund.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Warne, Anders & Coenen, Günter & Christoffel, Kai, 2010. "Forecasting with DSGE models," Working Paper Series 1185, European Central Bank.
    2. Anders Warne & Günter Coenen & Kai Christoffel, 2017. "Marginalized Predictive Likelihood Comparisons of Linear Gaussian State‐Space Models with Applications to DSGE, DSGE‐VAR, and VAR Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(1), pages 103-119, January.
    3. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    4. Stelios Bekiros & Alessia Paccagnini, 2013. "On the predictability of time-varying VAR and DSGE models," Empirical Economics, Springer, vol. 45(1), pages 635-664, August.
    5. Alessia Paccagnini, 2012. "Comparing Hybrid DSGE Models," Working Papers 228, University of Milano-Bicocca, Department of Economics, revised Dec 2012.
    6. Bekiros Stelios & Paccagnini Alessia, 2015. "Estimating point and density forecasts for the US economy with a factor-augmented vector autoregressive DSGE model," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 19(2), pages 107-136, April.
    7. Bekiros, Stelios D. & Paccagnini, Alessia, 2014. "Bayesian forecasting with small and medium scale factor-augmented vector autoregressive DSGE models," Computational Statistics & Data Analysis, Elsevier, vol. 71(C), pages 298-323.
    8. McAdam, Peter & Warne, Anders, 2020. "Density forecast combinations: the real-time dimension," Working Paper Series 2378, European Central Bank.
    9. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    10. Tim Oliver Berg, 2016. "Multivariate Forecasting with BVARs and DSGE Models," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(8), pages 718-740, December.
    11. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.
    12. Ulrich Gunter, 2019. "Estimating and forecasting with a two-country DSGE model of the Euro area and the USA: the merits of diverging interest-rate rules," Empirical Economics, Springer, vol. 56(4), pages 1283-1323, April.
    13. Warne, Anders, 2023. "DSGE model forecasting: rational expectations vs. adaptive learning," Working Paper Series 2768, European Central Bank.
    14. Lindé, Jesper & Smets, Frank & Wouters, Rafael, 2016. "Challenges for Central Banks´ Macro Models," Working Paper Series 323, Sveriges Riksbank (Central Bank of Sweden).
    15. Marco Del Negro & Frank Schorfheide, 2009. "Monetary Policy Analysis with Potentially Misspecified Models," American Economic Review, American Economic Association, vol. 99(4), pages 1415-1450, September.
    16. Henzel, Steffen R. & Mayr, Johannes, 2013. "The mechanics of VAR forecast pooling—A DSGE model based Monte Carlo study," The North American Journal of Economics and Finance, Elsevier, vol. 24(C), pages 1-24.
    17. Maik H. Wolters, 2015. "Evaluating Point and Density Forecasts of DSGE Models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(1), pages 74-96, January.
    18. Christoffel, Kai & Coenen, Gunter & Warne, Anders, 2007. "Conditional versus unconditional forecasting with the New Area-Wide Model of the euro area," MPRA Paper 76759, University Library of Munich, Germany.
    19. Thomai Filippeli, 2011. "Theoretical Priors for BVAR Models & Quasi-Bayesian DSGE Model Estimation," 2011 Meeting Papers 396, Society for Economic Dynamics.
    20. McAdam, Peter & Warne, Anders, 2019. "Euro area real-time density forecasting with financial or labor market frictions," International Journal of Forecasting, Elsevier, vol. 35(2), pages 580-600.

    More about this item

    Keywords

    Bayesian inference; forecasting; Kalman filter; Missing data; Monte Carlo integration;
    All these keywords.

    JEL classification:

    • C11 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Bayesian Analysis: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ecb:ecbwps:20131536. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Official Publications (email available below). General contact details of provider: https://edirc.repec.org/data/emieude.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.