IDEAS home Printed from https://ideas.repec.org/a/wly/japmet/v37y2022i1p3-22.html
   My bibliography  Save this article

Bootstrap inference and diagnostics in state space models: With applications to dynamic macro models

Author

Listed:
  • Giovanni Angelini
  • Giuseppe Cavaliere
  • Luca Fanelli

Abstract

This paper investigates the potentials of the bootstrap as a tool for inference on the parameters of macroeconometric models which admit a state space representation. We consider a bootstrap estimator of the parameters of state space models and show that the bootstrap realizations of this estimator, usually employed to approximate asymptotic confidence intervals, p‐values, and critical values of tests, can be also constructively used to build a test for forms of misspecifications which invalidate asymptotic normality. The test evaluates how “close or distant” the estimated state space model is from the case where asymptotic inference based on the Gaussian distribution applies. We derive sufficient conditions on the number of bootstrap repetitions, B, relative to the number of sample observations, T, for the test statistic to have a well‐defined asymptotic distribution under the null. Throughout the paper, we focus on the state space form of small‐scale monetary dynamic stochastic general equilibrium (DSGE) models and investigate the usefulness of our approach through Monte Carlo experiments and empirical illustrations based on US quarterly data. Results show that (i) bootstrapping the state space form provides highly reliable inference and (ii) the suggested test detects weakly identified parameters reasonably well in finite samples.

Suggested Citation

  • Giovanni Angelini & Giuseppe Cavaliere & Luca Fanelli, 2022. "Bootstrap inference and diagnostics in state space models: With applications to dynamic macro models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(1), pages 3-22, January.
  • Handle: RePEc:wly:japmet:v:37:y:2022:i:1:p:3-22
    DOI: 10.1002/jae.2843
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/jae.2843
    Download Restriction: no

    File URL: https://libkey.io/10.1002/jae.2843?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Kilian, Lutz & Demiroglu, Ufuk, 2000. "Residual-Based Tests for Normality in Autoregressions: Asymptotic Theory and Simulation Evidence," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(1), pages 40-50, January.
    2. Dovonon, Prosper & Gonçalves, Sílvia, 2017. "Bootstrapping the GMM overidentification test under first-order underidentification," Journal of Econometrics, Elsevier, vol. 201(1), pages 43-71.
    3. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez & Thomas J. Sargent & Mark W. Watson, 2007. "ABCs (and Ds) of Understanding VARs," American Economic Review, American Economic Association, vol. 97(3), pages 1021-1026, June.
    4. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models—Rejoinder," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 211-219.
    5. Patrick Fève & Julien Matheron & Jean‐Guillaume Sahuc, 2009. "Minimum Distance Estimation and Testing of DSGE Models from Structural VARs," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 71(6), pages 883-894, December.
    6. Gunnar Bårdsen & Luca Fanelli, 2015. "Frequentist Evaluation of Small DSGE Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(3), pages 307-322, July.
    7. Thomas A. Lubik & Frank Schorfheide, 2004. "Testing for Indeterminacy: An Application to U.S. Monetary Policy," American Economic Review, American Economic Association, vol. 94(1), pages 190-217, March.
    8. Ivana Komunjer & Serena Ng, 2011. "Dynamic Identification of Dynamic Stochastic General Equilibrium Models," Econometrica, Econometric Society, vol. 79(6), pages 1995-2032, November.
    9. Giuseppe Cavaliere & Iliyan Georgiev, 2020. "Inference Under Random Limit Bootstrap Measures," Econometrica, Econometric Society, vol. 88(6), pages 2547-2574, November.
    10. Guerron-Quintana, Pablo & Inoue, Atsushi & Kilian, Lutz, 2017. "Impulse response matching estimators for DSGE models," Journal of Econometrics, Elsevier, vol. 196(1), pages 144-155.
    11. Commandeur, Jacques J.F. & Koopman, Siem Jan, 2007. "An Introduction to State Space Time Series Analysis," OUP Catalogue, Oxford University Press, number 9780199228874, Decembrie.
    12. Giuseppe Cavaliere & Heino Bohn Nielsen & Anders Rahbek, 2017. "On the Consistency of Bootstrap Testing for a Parameter on the Boundary of the Parameter Space," Journal of Time Series Analysis, Wiley Blackwell, vol. 38(4), pages 513-534, July.
    13. James H. Stock & Mark W. Watson, 2018. "Identification and Estimation of Dynamic Causal Effects in Macroeconomics Using External Instruments," Economic Journal, Royal Economic Society, vol. 128(610), pages 917-948, May.
    14. Efrem Castelnuovo & Luca Fanelli, 2015. "Monetary Policy Indeterminacy and Identification Failures in the U.S.: Results from A Robust Test," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 30(6), pages 924-947, September.
    15. Zhongjun Qu & Denis Tkachenko, 2017. "Global Identification in DSGE Models Allowing for Indeterminacy," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 84(3), pages 1306-1345.
    16. Goncalves, Silvia & Kilian, Lutz, 2004. "Bootstrapping autoregressions with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 123(1), pages 89-120, November.
    17. Sungbae An & Frank Schorfheide, 2007. "Bayesian Analysis of DSGE Models," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 113-172.
    18. Andrzej Kocięcki & Marcin Kolasa, 2018. "Global identification of linearized DSGE models," Quantitative Economics, Econometric Society, vol. 9(3), pages 1243-1263, November.
    19. Rudolf Beran, 1997. "Diagnosing Bootstrap Success," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 49(1), pages 1-24, March.
    20. Isaiah Andrews & Anna Mikusheva, 2014. "Weak Identification in Maximum Likelihood: A Question of Information," American Economic Review, American Economic Association, vol. 104(5), pages 195-199, May.
    21. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    22. Hall, Alastair R. & Inoue, Atsushi & Nason, James M. & Rossi, Barbara, 2012. "Information criteria for impulse response function matching estimation of DSGE models," Journal of Econometrics, Elsevier, vol. 170(2), pages 499-518.
    23. Inoue, Atsushi & Rossi, Barbara, 2011. "Testing for weak identification in possibly nonlinear models," Journal of Econometrics, Elsevier, vol. 161(2), pages 246-261, April.
    24. Canova, Fabio & Sala, Luca, 2009. "Back to square one: Identification issues in DSGE models," Journal of Monetary Economics, Elsevier, vol. 56(4), pages 431-449, May.
    25. Karel Mertens & Morten O. Ravn, 2013. "The Dynamic Effects of Personal and Corporate Income Tax Changes in the United States," American Economic Review, American Economic Association, vol. 103(4), pages 1212-1247, June.
    26. Jurgen A. Doornik & Henrik Hansen, 2008. "An Omnibus Test for Univariate and Multivariate Normality," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 70(s1), pages 927-939, December.
    27. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    28. Marcelo J. Moreira & Jack R. Porter & Gustavo A. Suarez, 2004. "Bootstrap and Higher-Order Expansion Validity When Instruments May Be Weak," NBER Technical Working Papers 0302, National Bureau of Economic Research, Inc.
    29. Durbin, James & Koopman, Siem Jan, 2012. "Time Series Analysis by State Space Methods," OUP Catalogue, Oxford University Press, edition 2, number 9780199641178, Decembrie.
    30. Le, Vo Phuong Mai & Meenagh, David & Minford, Patrick & Wickens, Michael, 2011. "How much nominal rigidity is there in the US economy? Testing a new Keynesian DSGE model using indirect inference," Journal of Economic Dynamics and Control, Elsevier, vol. 35(12), pages 2078-2104.
    31. Cho, Seonghoon & Moreno, Antonio, 2006. "A Small-Sample Study of the New-Keynesian Macro Model," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 38(6), pages 1461-1481, September.
    32. Harvey,Andrew & Koopman,Siem Jan & Shephard,Neil (ed.), 2004. "State Space and Unobserved Component Models," Cambridge Books, Cambridge University Press, number 9780521835954.
    33. Margaret M. McConnell & Gabriel Perez-Quiros, 2000. "Output fluctuations in the United States: what has changed since the early 1980s?," Proceedings, Federal Reserve Bank of San Francisco, issue Mar.
    34. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    35. Morris, Stephen D., 2017. "DSGE pileups," Journal of Economic Dynamics and Control, Elsevier, vol. 74(C), pages 56-86.
    36. James H. Stock & Jonathan Wright, 2000. "GMM with Weak Identification," Econometrica, Econometric Society, vol. 68(5), pages 1055-1096, September.
    37. Isaiah Andrews & Anna Mikusheva, 2015. "Maximum likelihood inference in weakly identified dynamic stochastic general equilibrium models," Quantitative Economics, Econometric Society, vol. 6(1), pages 123-152, March.
    38. Zhongjun Qu, 2014. "Inference in dynamic stochastic general equilibrium models with possible weak identification," Quantitative Economics, Econometric Society, vol. 5, pages 457-494, July.
    39. Zhongjun Qu & Denis Tkachenko, 2012. "Identification and frequency domain quasi‐maximum likelihood estimation of linearized dynamic stochastic general equilibrium models," Quantitative Economics, Econometric Society, vol. 3(1), pages 95-132, March.
    40. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
    41. Dufour, Jean-Marie & Khalaf, Lynda & Kichian, Maral, 2013. "Identification-robust analysis of DSGE and structural macroeconomic models," Journal of Monetary Economics, Elsevier, vol. 60(3), pages 340-350.
    42. Kleibergen, Frank & Mavroeidis, Sophocles, 2009. "Weak Instrument Robust Tests in GMM and the New Keynesian Phillips Curve," Journal of Business & Economic Statistics, American Statistical Association, vol. 27(3), pages 293-311.
    43. Sophocles Mavroeidis, 2010. "Monetary Policy Rules and Macroeconomic Stability: Some New Evidence," American Economic Review, American Economic Association, vol. 100(1), pages 491-503, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Morris, Stephen D., 2017. "DSGE pileups," Journal of Economic Dynamics and Control, Elsevier, vol. 74(C), pages 56-86.
    2. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    3. Paccagnini, Alessia, 2017. "Dealing with Misspecification in DSGE Models: A Survey," MPRA Paper 82914, University Library of Munich, Germany.
    4. Khalaf, Lynda & Lin, Zhenjiang, 2021. "Projection-based inference with particle swarm optimization," Journal of Economic Dynamics and Control, Elsevier, vol. 128(C).
    5. Giovanni Angelini & Luca Fanelli, 2016. "Misspecification and Expectations Correction in New Keynesian DSGE Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 78(5), pages 623-649, October.
    6. Prosper Dovonon & Alastair R. Hall, 2017. "The Asymptotic Properties of GMM and Indirect Inference Under Second-Order Identification," Economics Discussion Paper Series 1705, Economics, The University of Manchester.
    7. Dovonon, Prosper & Hall, Alastair R., 2018. "The asymptotic properties of GMM and indirect inference under second-order identification," Journal of Econometrics, Elsevier, vol. 205(1), pages 76-111.
    8. Kocięcki, Andrzej & Kolasa, Marcin, 2023. "A solution to the global identification problem in DSGE models," Journal of Econometrics, Elsevier, vol. 236(2).
    9. Komunjer, Ivana & Zhu, Yinchu, 2020. "Likelihood ratio testing in linear state space models: An application to dynamic stochastic general equilibrium models," Journal of Econometrics, Elsevier, vol. 218(2), pages 561-586.
    10. Guerron-Quintana, Pablo & Inoue, Atsushi & Kilian, Lutz, 2017. "Impulse response matching estimators for DSGE models," Journal of Econometrics, Elsevier, vol. 196(1), pages 144-155.
    11. Castelnuovo, Efrem, 2016. "Modest macroeconomic effects of monetary policy shocks during the great moderation: An alternative interpretation," Journal of Macroeconomics, Elsevier, vol. 47(PB), pages 300-314.
    12. Raffaella Giacomini, 2013. "The relationship between DSGE and VAR models," CeMMAP working papers CWP21/13, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    13. Giesen, Sebastian & Scheufele, Rolf, 2016. "Effects of incorrect specification on the finite sample properties of full and limited information estimators in DSGE models," Journal of Macroeconomics, Elsevier, vol. 48(C), pages 1-18.
    14. Krogh, Tord S., 2015. "Macro frictions and theoretical identification of the New Keynesian Phillips curve," Journal of Macroeconomics, Elsevier, vol. 43(C), pages 191-204.
    15. Anna Mikusheva, 2014. "Estimation of dynamic stochastic general equilibrium models (in Russian)," Quantile, Quantile, issue 12, pages 1-21, February.
    16. Sophocles Mavroeidis & Mikkel Plagborg-Møller & James H. Stock, 2014. "Empirical Evidence on Inflation Expectations in the New Keynesian Phillips Curve," Journal of Economic Literature, American Economic Association, vol. 52(1), pages 124-188, March.
    17. Angelini, Giovanni, 2020. "Bootstrap lag selection in DSGE models with expectations correction," Econometrics and Statistics, Elsevier, vol. 14(C), pages 38-48.
    18. David Meenagh & Patrick Minford & Michael Wickens & Yongdeng Xu, 2019. "Testing DSGE Models by Indirect Inference: a Survey of Recent Findings," Open Economies Review, Springer, vol. 30(3), pages 593-620, July.
    19. Stephen Morris, 2014. "The Statistical Implications of Common Identifying Restrictions for DSGE Models," 2014 Meeting Papers 738, Society for Economic Dynamics.
    20. Ivashchenko, Sergey & Mutschler, Willi, 2020. "The effect of observables, functional specifications, model features and shocks on identification in linearized DSGE models," Economic Modelling, Elsevier, vol. 88(C), pages 280-292.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:japmet:v:37:y:2022:i:1:p:3-22. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/0883-7252/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.