IDEAS home Printed from https://ideas.repec.org/a/taf/jnlbes/v33y2015i3p307-322.html
   My bibliography  Save this article

Frequentist Evaluation of Small DSGE Models

Author

Listed:
  • Gunnar Bårdsen
  • Luca Fanelli

Abstract

This article proposes a new evaluation approach for the class of small-scale "hybrid" new Keynesian dynamic stochastic general equilibrium (NK-DSGE) models typically used in monetary policy and business cycle analysis. The empirical assessment of the NK-DSGE model is based on a conditional sequence of likelihood-based tests conducted in a vector autoregressive (VAR) system, in which both the low- and high-frequency implications of the model are addressed in a coherent framework. If the low-frequency behavior of the original time series of the model can be approximated by nonstationary processes, stationarity must be imposed by removing the stochastic trends. This gives rise to a set of recoverable unit roots/cointegration restrictions, in addition to the short-run cross-equation restrictions. The procedure is based on the sequence "LR1→LR2→LR3," where LR1 is the cointegration rank test, LR2 is the cointegration matrix test, and LR3 is the cross-equation restrictions test: LR2 is computed conditional on LR1 and LR3 is computed conditional on LR2. The Type I errors of the three tests are set consistently with a prefixed overall nominal significance level. A bootstrap analog of the testing strategy is proposed in small samples. We show that the information stemming from the individual tests can be used constructively to uncover which features of the data are not captured by the theoretical model and thus to rectify, when possible, the specification. We investigate the empirical size properties of the proposed testing strategy by a Monte Carlo experiment and show the empirical usefulness of our approach by estimating and testing a monetary business cycle NK-DSGE model using U.S. quarterly data. Supplementary materials for this article are available online.

Suggested Citation

  • Gunnar Bårdsen & Luca Fanelli, 2015. "Frequentist Evaluation of Small DSGE Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 307-322, July.
  • Handle: RePEc:taf:jnlbes:v:33:y:2015:i:3:p:307-322
    DOI: 10.1080/07350015.2014.948724
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/07350015.2014.948724
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1080/07350015.2014.948724?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to look for a different version below or search for a different version of it.

    Other versions of this item:

    References listed on IDEAS

    as
    1. Frank Schorfheide, 2011. "Estimation and Evaluation of DSGE Models: Progress and Challenges," NBER Working Papers 16781, National Bureau of Economic Research, Inc.
    2. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Thomas J. Sargent & Mark W. Watson, 2007. "ABCs (and Ds) of Understanding VARs," American Economic Review, American Economic Association, vol. 97(3), pages 1021-1026, June.
    3. Geert Bekaert & Seonghoon Cho & Antonio Moreno, 2010. "New Keynesian Macroeconomics and the Term Structure," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 42(1), pages 33-62, February.
    4. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models—Rejoinder," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 211-219.
    5. Bewley, Ronald & Orden, David & Yang, Minxian & Fisher, Lance A., 1994. "Comparison of Box--Tiao and Johansen canonical estimators of cointegrating vectors in VEC(1) models," Journal of Econometrics, Elsevier, vol. 64(1-2), pages 3-27.
    6. Thomas A. Lubik & Frank Schorfheide, 2004. "Testing for Indeterminacy: An Application to U.S. Monetary Policy," American Economic Review, American Economic Association, vol. 94(1), pages 190-217, March.
    7. Hansen, Lars Peter & Sargent, Thomas J., 1980. "Formulating and estimating dynamic linear rational expectations models," Journal of Economic Dynamics and Control, Elsevier, vol. 2(1), pages 7-46, May.
    8. Martin Fukač & Adrian Pagan, 2010. "Limited information estimation and evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(1), pages 55-70, January.
    9. Lubik, Thomas A. & Schorfheide, Frank, 2003. "Computing sunspot equilibria in linear rational expectations models," Journal of Economic Dynamics and Control, Elsevier, vol. 28(2), pages 273-285, November.
    10. Pieter Omtzigt & Stefano Fachin, 2006. "The Size and Power of Bootstrap and Bartlett-Corrected Tests of Hypotheses on the Cointegrating Vectors," Econometric Reviews, Taylor & Francis Journals, vol. 25(1), pages 41-60.
    11. Soderlind, Paul & Vredin, Anders, 1996. "Applied Cointegration Analysis in the Mirror of Macroeconomic Theory," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(4), pages 363-381, July-Aug..
    12. Johansen, Søren, 2000. "A Bartlett Correction Factor For Tests On The Cointegrating Relations," Econometric Theory, Cambridge University Press, vol. 16(5), pages 740-778, October.
    13. Ravenna, Federico, 2007. "Vector autoregressions and reduced form representations of DSGE models," Journal of Monetary Economics, Elsevier, vol. 54(7), pages 2048-2064, October.
    14. Stephane Dees & M. Hashem Pesaran & L. Vanessa Smith & Ron P. Smith, 2009. "Identification of New Keynesian Phillips Curves from a Global Perspective," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 41(7), pages 1481-1502, October.
    15. Harbo, Ingrid, et al, 1998. "Asymptotic Inference on Cointegrating Rank in Partial Systems," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(4), pages 388-399, October.
    16. Luca Benati & Paolo Surico, 2009. "VAR Analysis and the Great Moderation," American Economic Review, American Economic Association, vol. 99(4), pages 1636-1652, September.
    17. Cogley, Timothy, 2001. "Estimating and testing rational expectations models when the trend specification is uncertain," Journal of Economic Dynamics and Control, Elsevier, vol. 25(10), pages 1485-1525, October.
    18. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    19. Carlstrom, Charles T. & Fuerst, Timothy S. & Paustian, Matthias, 2009. "Monetary policy shocks, Choleski identification, and DNK models," Journal of Monetary Economics, Elsevier, vol. 56(7), pages 1014-1021, October.
    20. Fanelli, Luca, 2012. "Determinacy, indeterminacy and dynamic misspecification in linear rational expectations models," Journal of Econometrics, Elsevier, vol. 170(1), pages 153-163.
    21. Ruge-Murcia, Francisco J., 2007. "Methods to estimate dynamic stochastic general equilibrium models," Journal of Economic Dynamics and Control, Elsevier, vol. 31(8), pages 2599-2636, August.
    22. Smith, A A, Jr, 1993. "Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 63-84, Suppl. De.
    23. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    24. Iskrev, Nikolay, 2010. "Local identification in DSGE models," Journal of Monetary Economics, Elsevier, vol. 57(2), pages 189-202, March.
    25. Canova, Fabio & Sala, Luca, 2009. "Back to square one: Identification issues in DSGE models," Journal of Monetary Economics, Elsevier, vol. 56(4), pages 431-449, May.
    26. Luca Fanelli, 2011. "Robust identification conditions for determinate and indeterminate linear rational expectations models," Quaderni di Dipartimento 1, Department of Statistics, University of Bologna.
    27. Johansen, Soren & Swensen, Anders Rygh, 1999. "Testing exact rational expectations in cointegrated vector autoregressive models," Journal of Econometrics, Elsevier, vol. 93(1), pages 73-91, November.
    28. Johansen, Soren, 1991. "Estimation and Hypothesis Testing of Cointegration Vectors in Gaussian Vector Autoregressive Models," Econometrica, Econometric Society, vol. 59(6), pages 1551-1580, November.
    29. Colander,David (ed.), 2006. "Post Walrasian Macroeconomics," Cambridge Books, Cambridge University Press, number 9780521865487.
    30. Campbell, John Y & Shiller, Robert J, 1987. "Cointegration and Tests of Present Value Models," Journal of Political Economy, University of Chicago Press, vol. 95(5), pages 1062-1088, October.
    31. Gonzalo, Jesus, 1994. "Five alternative methods of estimating long-run equilibrium relationships," Journal of Econometrics, Elsevier, vol. 60(1-2), pages 203-233.
    32. Hashem M. Pesaran & Ron P. Smith, 2011. "Beyond the DSGE Straitjacket," CESifo Working Paper Series 3447, CESifo.
    33. Gorodnichenko, Yuriy & Ng, Serena, 2010. "Estimation of DSGE models when the data are persistent," Journal of Monetary Economics, Elsevier, vol. 57(3), pages 325-340, April.
    34. Marimon, Ramon & Scott, Andrew (ed.), 1999. "Computational Methods for the Study of Dynamic Economies," OUP Catalogue, Oxford University Press, number 9780198294979, Decembrie.
    35. Jurgen A. Doornik, 1998. "Approximations To The Asymptotic Distributions Of Cointegration Tests," Journal of Economic Surveys, Wiley Blackwell, vol. 12(5), pages 573-593, December.
    36. Canova, Fabio & Ferroni, Filippo, 2012. "The dynamics of US inflation: Can monetary policy explain the changes?," Journal of Econometrics, Elsevier, vol. 167(1), pages 47-60.
    37. Cho, Seonghoon & Moreno, Antonio, 2006. "A Small-Sample Study of the New-Keynesian Macro Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(6), pages 1461-1481, September.
    38. Peter N. Ireland, 2004. "Technology Shocks in the New Keynesian Model," The Review of Economics and Statistics, MIT Press, vol. 86(4), pages 923-936, November.
    39. Luca Fanelli, 2008. "Testing the New Keynesian Phillips Curve Through Vector Autoregressive Models: Results from the Euro Area," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(1), pages 53-66, February.
    40. Li, Hong, 2007. "Small-sample inference in rational expectations models with persistent data," Economics Letters, Elsevier, vol. 95(2), pages 203-210, May.
    41. Luca Fanelli & Giulio Palomba, 2011. "Simulation‐based tests of forward‐looking models under VAR learning dynamics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(5), pages 762-782, August.
    42. Fachin, Stefano, 2000. "Bootstrap and Asymptotic Tests of Long-Run Relationships in Cointegrated Systems," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 62(4), pages 543-551, September.
    43. Aris Spanos, 2011. "Foundational Issues in Statistical Modeling: Statistical Model Specification and Validation," Rationality, Markets and Morals, Frankfurt School Verlag, Frankfurt School of Finance & Management, vol. 2(47), October.
    44. Li, Hongyi & Maddala, G. S., 1997. "Bootstrapping cointegrating regressions," Journal of Econometrics, Elsevier, vol. 80(2), pages 297-318, October.
    45. Iskrev, Nikolay, 2008. "Evaluating the information matrix in linearized DSGE models," Economics Letters, Elsevier, vol. 99(3), pages 607-610, June.
    46. Anders Rygh Swensen, 2006. "Bootstrap Algorithms for Testing and Determining the Cointegration Rank in VAR Models -super-1," Econometrica, Econometric Society, vol. 74(6), pages 1699-1714, November.
    47. Efrem Castelnuovo & Luca Fanelli, 2011. "Monetary policy indeterminacy in the U.S.: results from a classical test," Quaderni di Dipartimento 8, Department of Statistics, University of Bologna.
    48. Jurgen A. Doornik, 1998. "Approximations To The Asymptotic Distributions Of Cointegration Tests," Journal of Economic Surveys, Wiley Blackwell, vol. 12(5), pages 573-593, December.
    49. David N. DeJong & Chetan Dave, 2007. "Introduction to Structural Macroeconometrics," Introductory Chapters, in: Structural Macroeconometrics, Princeton University Press.
    50. Stefano Fachin, 2000. "Bootstrap and Asymptotic Tests of Long‐run Relationships in Cointegrated Systems," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 62(4), pages 543-551, September.
    51. Soren Johansen, 2002. "A Small Sample Correction for the Test of Cointegrating Rank in the Vector Autoregressive Model," Econometrica, Econometric Society, vol. 70(5), pages 1929-1961, September.
    52. Binder,M. & Pesaran,H.M., 1995. "Multivariate Rational Expectations Models and Macroeconomic Modelling: A Review and Some New Results," Cambridge Working Papers in Economics 9415, Faculty of Economics, University of Cambridge.
    53. Sophocles Mavroeidis, 2010. "Monetary Policy Rules and Macroeconomic Stability: Some New Evidence," American Economic Review, American Economic Association, vol. 100(1), pages 491-503, March.
    54. Mikael Juselius, 2011. "Testing Steady‐State Restrictions of Linear Rational Expectations Models when Data are Highly Persistent," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 73(3), pages 315-334, June.
    55. Colander,David (ed.), 2006. "Post Walrasian Macroeconomics," Cambridge Books, Cambridge University Press, number 9780521684200.
    56. Giuseppe Cavaliere & Anders Rahbek & A. M. Robert Taylor, 2012. "Bootstrap Determination of the Co‐Integration Rank in Vector Autoregressive Models," Econometrica, Econometric Society, vol. 80(4), pages 1721-1740, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Angelini, Giovanni, 2020. "Bootstrap lag selection in DSGE models with expectations correction," Econometrics and Statistics, Elsevier, vol. 14(C), pages 38-48.
    2. Bjørnar Karlsen Kivedal, 2018. "A new Keynesian framework and wage and price dynamics in the USA," Empirical Economics, Springer, vol. 55(3), pages 1271-1289, November.
    3. Giovanni Angelini & Giuseppe Cavaliere & Luca Fanelli, 2022. "Bootstrap inference and diagnostics in state space models: With applications to dynamic macro models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 3-22, January.
    4. Morris, Stephen D., 2017. "DSGE pileups," Journal of Economic Dynamics and Control, Elsevier, vol. 74(C), pages 56-86.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Luca Fanelli, 2009. "Estimation of quasi-rational DSGE monetary models," Quaderni di Dipartimento 3, Department of Statistics, University of Bologna.
    2. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    3. Raffaella Giacomini, 2013. "The relationship between DSGE and VAR models," CeMMAP working papers CWP21/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    4. Giovanni Angelini & Luca Fanelli, 2016. "Misspecification and Expectations Correction in New Keynesian DSGE Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(5), pages 623-649, October.
    5. Blasques, Francisco & Duplinskiy, Artem, 2018. "Penalized indirect inference," Journal of Econometrics, Elsevier, vol. 205(1), pages 34-54.
    6. Fanelli, Luca, 2012. "Determinacy, indeterminacy and dynamic misspecification in linear rational expectations models," Journal of Econometrics, Elsevier, vol. 170(1), pages 153-163.
    7. Sophocles Mavroeidis & Mikkel Plagborg-Møller & James H. Stock, 2014. "Empirical Evidence on Inflation Expectations in the New Keynesian Phillips Curve," Journal of Economic Literature, American Economic Association, vol. 52(1), pages 124-188, March.
    8. Özer Karagedikli & Troy Matheson & Christie Smith & Shaun P. Vahey, 2010. "RBCs AND DSGEs: THE COMPUTATIONAL APPROACH TO BUSINESS CYCLE THEORY AND EVIDENCE," Journal of Economic Surveys, Wiley Blackwell, vol. 24(1), pages 113-136, February.
    9. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.
    10. Fanelli, Luca, 2008. "Evaluating New Keynesian Phillips Curve under VAR-Based Learning," Economics - The Open-Access, Open-Assessment E-Journal (2007-2020), Kiel Institute for the World Economy (IfW Kiel), vol. 2, pages 1-24.
    11. Luca Fanelli & Marco M. Sorge, 2015. "Indeterminacy, Misspecification and Forecastability: Good Luck in Bad Policy?," CSEF Working Papers 402, Centre for Studies in Economics and Finance (CSEF), University of Naples, Italy.
    12. Castelnuovo, Efrem, 2016. "Modest macroeconomic effects of monetary policy shocks during the great moderation: An alternative interpretation," Journal of Macroeconomics, Elsevier, vol. 47(PB), pages 300-314.
    13. Charles Olivier Mao Takongmo, 2021. "DSGE models, detrending, and the method of moments," Bulletin of Economic Research, Wiley Blackwell, vol. 73(1), pages 67-99, January.
    14. Raffaella Giacomini, 2013. "The relationship between DSGE and VAR models," CeMMAP working papers 21/13, Institute for Fiscal Studies.
    15. Castelnuovo, Efrem, 2013. "Monetary policy shocks and financial conditions: A Monte Carlo experiment," Journal of International Money and Finance, Elsevier, vol. 32(C), pages 282-303.
    16. David H. Bernstein & Bent Nielsen, 2019. "Asymptotic Theory for Cointegration Analysis When the Cointegration Rank Is Deficient," Econometrics, MDPI, vol. 7(1), pages 1-24, January.
    17. Gary Koop & M. Hashem Pesaran & Ron P. Smith, 2013. "On Identification of Bayesian DSGE Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(3), pages 300-314, July.
    18. Luca Fanelli & Giulio Palomba, 2011. "Simulation‐based tests of forward‐looking models under VAR learning dynamics," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(5), pages 762-782, August.
    19. Giesen, Sebastian & Scheufele, Rolf, 2016. "Effects of incorrect specification on the finite sample properties of full and limited information estimators in DSGE models," Journal of Macroeconomics, Elsevier, vol. 48(C), pages 1-18.
    20. Giovanni Angelini & Giuseppe Cavaliere & Luca Fanelli, 2022. "Bootstrap inference and diagnostics in state space models: With applications to dynamic macro models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 3-22, January.

    More about this item

    JEL classification:

    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling
    • E4 - Macroeconomics and Monetary Economics - - Money and Interest Rates
    • E5 - Macroeconomics and Monetary Economics - - Monetary Policy, Central Banking, and the Supply of Money and Credit

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:jnlbes:v:33:y:2015:i:3:p:307-322. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/UBES20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.