IDEAS home Printed from https://ideas.repec.org/p/unm/umagsb/2017022.html
   My bibliography  Save this paper

Inference for Impulse Responses under Model Uncertainty

Author

Listed:
  • Lieb, Lenard

    (Macro, International & Labour Economics, RS: GSBE EFME)

  • Smeekes, Stephan

    (QE Econometrics, RS: GSBE EFME)

Abstract

In many macroeconomic applications, impulse responses and their (bootstrap) confidence intervals are constructed by estimating a VAR model in levels - thus ignoring uncertainty regarding the true (unknown) cointegration rank. While it is well known that using a wrong cointegration rank leads to invalid (bootstrap) inference, we demonstrate that even if the rank is consistently estimated, ignoring uncertainty regarding the true rank can make inference highly unreliable for sample sizes encountered in macroeconomic applications. We investigate the effects of rank uncertainty in a simulation study, comparing several methods designed for handling model uncertainty. We propose a new method - Weighted Inference by Model Plausibility (WIMP) - that takes rank uncertainty into account in a fully data-driven way and outperforms all other methods considered in the simulation study. The WIMP method is shown to deliver intervals that are robust to rank uncertainty, yet allow for meaningful inference, approaching fixed rank intervals when evidence for a particular rank is strong. We study the potential ramifications of rank uncertainty on applied macroeconomic analysis by re-assessing the effects of fiscal policy shocks based on a variety of identification schemes that have been considered in the literature. We demonstrate how sensitive the results are to the treatment of the cointegration rank, and show how formally accounting for rank uncertainty can affect the conclusions.

Suggested Citation

  • Lieb, Lenard & Smeekes, Stephan, 2017. "Inference for Impulse Responses under Model Uncertainty," Research Memorandum 022, Maastricht University, Graduate School of Business and Economics (GSBE).
  • Handle: RePEc:unm:umagsb:2017022
    DOI: 10.26481/umagsb.2017022
    as

    Download full text from publisher

    File URL: https://cris.maastrichtuniversity.nl/ws/files/16464755/RM17022.pdf
    Download Restriction: no

    File URL: https://libkey.io/10.26481/umagsb.2017022?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Liao, Zhipeng & Phillips, Peter C. B., 2015. "Automated Estimation Of Vector Error Correction Models," Econometric Theory, Cambridge University Press, vol. 31(3), pages 581-646, June.
    2. Brüggemann, Ralf & Jentsch, Carsten & Trenkler, Carsten, 2016. "Inference in VARs with conditional heteroskedasticity of unknown form," Journal of Econometrics, Elsevier, vol. 191(1), pages 69-85.
    3. Stefan Bruder & Michael Wolf, 2018. "Balanced Bootstrap Joint Confidence Bands for Structural Impulse Response Functions," Journal of Time Series Analysis, Wiley Blackwell, vol. 39(5), pages 641-664, September.
    4. Geweke, John & Koop, Gary & van Dijk, Herman (ed.), 2011. "The Oxford Handbook of Bayesian Econometrics," OUP Catalogue, Oxford University Press, number 9780199559084, Decembrie.
    5. Inoue, Atsushi & Kilian, Lutz, 2016. "Joint confidence sets for structural impulse responses," Journal of Econometrics, Elsevier, vol. 192(2), pages 421-432.
    6. Pesavento, Elena & Rossi, Barbara, 2007. "Impulse response confidence intervals for persistent data: What have we learned?," Journal of Economic Dynamics and Control, Elsevier, vol. 31(7), pages 2398-2412, July.
    7. Andrew Mountford & Harald Uhlig, 2009. "What are the effects of fiscal policy shocks?," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(6), pages 960-992.
    8. Karel Mertens & Morten Overgaard Ravn, 2011. "Understanding the Aggregate Effects of Anticipated and Unanticipated Tax Policy Shocks," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(1), pages 27-54, January.
    9. Mertens, Karel & Ravn, Morten O., 2014. "A reconciliation of SVAR and narrative estimates of tax multipliers," Journal of Monetary Economics, Elsevier, vol. 68(S), pages 1-19.
    10. Jardet, Caroline & Monfort, Alain & Pegoraro, Fulvio, 2013. "No-arbitrage Near-Cointegrated VAR(p) term structure models, term premia and GDP growth," Journal of Banking & Finance, Elsevier, vol. 37(2), pages 389-402.
    11. Elena Pesavento & Barbara Rossi, 2006. "Small‐sample confidence intervals for multivariate impulse response functions at long horizons," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 21(8), pages 1135-1155, December.
    12. Del Negro, Marco & Schorfheide, Frank & Smets, Frank & Wouters, Rafael, 2007. "On the Fit of New Keynesian Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 123-143, April.
    13. Gospodinov, Nikolay, 2010. "Inference in Nearly Nonstationary SVAR Models With Long-Run Identifying Restrictions," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(1), pages 1-12.
    14. Nikolay Gospodinov & Alex Maynard & Elena Pesavento, 2011. "Sensitivity of Impulse Responses to Small Low-Frequency Comovements: Reconciling the Evidence on the Effects of Technology Shocks," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(4), pages 455-467, October.
    15. Hjort N.L. & Claeskens G., 2003. "Frequentist Model Average Estimators," Journal of the American Statistical Association, American Statistical Association, vol. 98, pages 879-899, January.
    16. Karel Mertens & Morten Overgaard Ravn, 2011. "Understanding the Aggregate Effects of Anticipated and Unanticipated Tax Policy Shocks," Review of Economic Dynamics, Elsevier for the Society for Economic Dynamics, vol. 14(1), pages 27-54, January.
    17. Cavaliere, Giuseppe & Rahbek, Anders & Taylor, A.M. Robert, 2010. "Cointegration Rank Testing Under Conditional Heteroskedasticity," Econometric Theory, Cambridge University Press, vol. 26(6), pages 1719-1760, December.
    18. Lütkepohl, Helmut & Staszewska-Bystrova, Anna & Winker, Peter, 2015. "Comparison of methods for constructing joint confidence bands for impulse response functions," International Journal of Forecasting, Elsevier, vol. 31(3), pages 782-798.
    19. Karel Mertens & Morten O. Ravn, 2012. "Empirical Evidence on the Aggregate Effects of Anticipated and Unanticipated US Tax Policy Shocks," American Economic Journal: Economic Policy, American Economic Association, vol. 4(2), pages 145-181, May.
    20. Domenico Giannone & Michele Lenza & Giorgio E. Primiceri, 2019. "Priors for the Long Run," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 565-580, April.
    21. Ramey, Valerie A. & Shapiro, Matthew D., 1998. "Costly capital reallocation and the effects of government spending," Carnegie-Rochester Conference Series on Public Policy, Elsevier, vol. 48(1), pages 145-194, June.
    22. Nikolay Gospodinov, 2004. "Asymptotic confidence intervals for impulse responses of near-integrated processes," Econometrics Journal, Royal Economic Society, vol. 7(2), pages 505-527, December.
    23. Karel Mertens & Morten O. Ravn, 2013. "The Dynamic Effects of Personal and Corporate Income Tax Changes in the United States," American Economic Review, American Economic Association, vol. 103(4), pages 1212-1247, June.
    24. Davidson, Russell & MacKinnon, James G., 2002. "Bootstrap J tests of nonnested linear regression models," Journal of Econometrics, Elsevier, vol. 109(1), pages 167-193, July.
    25. Kilian, Lutz & Chang, Pao-Li, 2000. "How accurate are confidence intervals for impulse responses in large VAR models?," Economics Letters, Elsevier, vol. 69(3), pages 299-307, December.
    26. Xu Cheng & P eter C. B. Phillips, 2009. "Semiparametric cointegrating rank selection," Econometrics Journal, Royal Economic Society, vol. 12(s1), pages 83-104, January.
    27. Chao, John C. & Phillips, Peter C. B., 1999. "Model selection in partially nonstationary vector autoregressive processes with reduced rank structure," Journal of Econometrics, Elsevier, vol. 91(2), pages 227-271, August.
    28. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    29. Phillips, Peter C. B., 1998. "Impulse response and forecast error variance asymptotics in nonstationary VARs," Journal of Econometrics, Elsevier, vol. 83(1-2), pages 21-56.
    30. Benkwitz, Alexander & Lütkepohl, Helmut & Wolters, Jürgen, 2001. "Comparison Of Bootstrap Confidence Intervals For Impulse Responses Of German Monetary Systems," Macroeconomic Dynamics, Cambridge University Press, vol. 5(1), pages 81-100, February.
    31. Cavaliere, Giuseppe & Rahbek, Anders & Taylor, A.M. Robert, 2010. "Testing for co-integration in vector autoregressions with non-stationary volatility," Journal of Econometrics, Elsevier, vol. 158(1), pages 7-24, September.
    32. Valerie A. Ramey, 2011. "Identifying Government Spending Shocks: It's all in the Timing," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 126(1), pages 1-50.
    33. Bradley Efron, 2014. "Estimation and Accuracy After Model Selection," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 991-1007, September.
    34. Atsushi Inoue & Lutz Kilian, 2002. "Bootstrapping Autoregressive Processes with Possible Unit Roots," Econometrica, Econometric Society, vol. 70(1), pages 377-391, January.
    35. Rodney Strachan & Herman K. van Dijk, "undated". "Bayesian Model Averaging in Vector Autoregressive Processes with an Investigation of Stability of the US Great Ratios and Risk of a Liquidity Trap in the USA, UK and Japan," MRG Discussion Paper Series 1407, School of Economics, University of Queensland, Australia.
    36. David H. Bernstein & Bent Nielsen, 2019. "Asymptotic Theory for Cointegration Analysis When the Cointegration Rank Is Deficient," Econometrics, MDPI, vol. 7(1), pages 1-24, January.
    37. Leeb, Hannes & Pötscher, Benedikt M., 2005. "Model Selection And Inference: Facts And Fiction," Econometric Theory, Cambridge University Press, vol. 21(1), pages 21-59, February.
    38. Wright, Jonathan H, 2000. "Confidence Intervals for Univariate Impulse Responses with a Near Unit Root," Journal of Business & Economic Statistics, American Statistical Association, vol. 18(3), pages 368-373, July.
    39. Choi, In, 2005. "Inconsistency of bootstrap for nonstationary, vector autoregressive processes," Statistics & Probability Letters, Elsevier, vol. 75(1), pages 39-48, November.
    40. Anna Mikusheva, 2012. "One‐Dimensional Inference in Autoregressive Models With the Potential Presence of a Unit Root," Econometrica, Econometric Society, vol. 80(1), pages 173-212, January.
    41. Johansen, Soren, 1995. "Likelihood-Based Inference in Cointegrated Vector Autoregressive Models," OUP Catalogue, Oxford University Press, number 9780198774501, Decembrie.
    42. Russell Davidson & James MacKinnon, 2002. "Fast Double Bootstrap Tests Of Nonnested Linear Regression Models," Econometric Reviews, Taylor & Francis Journals, vol. 21(4), pages 419-429.
    43. Villani, Mattias, 2001. "Bayesian prediction with cointegrated vector autoregressions," International Journal of Forecasting, Elsevier, vol. 17(4), pages 585-605.
    44. Olivier Blanchard & Roberto Perotti, 2002. "An Empirical Characterization of the Dynamic Effects of Changes in Government Spending and Taxes on Output," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(4), pages 1329-1368.
    45. Anders Rygh Swensen, 2006. "Bootstrap Algorithms for Testing and Determining the Cointegration Rank in VAR Models -super-1," Econometrica, Econometric Society, vol. 74(6), pages 1699-1714, November.
    46. Cheng, Xu & Phillips, Peter C.B., 2012. "Cointegrating rank selection in models with time-varying variance," Journal of Econometrics, Elsevier, vol. 169(2), pages 155-165.
    47. Phillips, Peter C B, 1996. "Econometric Model Determination," Econometrica, Econometric Society, vol. 64(4), pages 763-812, July.
    48. Lutz Kilian, 1998. "Small-Sample Confidence Intervals For Impulse Response Functions," The Review of Economics and Statistics, MIT Press, vol. 80(2), pages 218-230, May.
    49. Anna Mikusheva, 2007. "Uniform Inference in Autoregressive Models," Econometrica, Econometric Society, vol. 75(5), pages 1411-1452, September.
    50. James H. Stock & Mark W. Watson, 2012. "Disentangling the Channels of the 2007-2009 Recession," NBER Working Papers 18094, National Bureau of Economic Research, Inc.
    51. Giuseppe Cavaliere & Anders Rahbek & A. M. Robert Taylor, 2012. "Bootstrap Determination of the Co‐Integration Rank in Vector Autoregressive Models," Econometrica, Econometric Society, vol. 80(4), pages 1721-1740, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Inoue, Atsushi & Kilian, Lutz, 2020. "The uniform validity of impulse response inference in autoregressions," Journal of Econometrics, Elsevier, vol. 215(2), pages 450-472.
    2. José Luis Montiel Olea & Mikkel Plagborg‐Møller, 2021. "Local Projection Inference Is Simpler and More Robust Than You Think," Econometrica, Econometric Society, vol. 89(4), pages 1789-1823, July.
    3. Anh D. M. Nguyen & Luisanna Onnis & Raffaele Rossi, 2021. "The Macroeconomic Effects of Income and Consumption Tax Changes," American Economic Journal: Economic Policy, American Economic Association, vol. 13(2), pages 439-466, May.
    4. Ramey, V.A., 2016. "Macroeconomic Shocks and Their Propagation," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 71-162, Elsevier.
    5. Helmut Lütkepohl, 2013. "Vector autoregressive models," Chapters, in: Nigar Hashimzade & Michael A. Thornton (ed.), Handbook of Research Methods and Applications in Empirical Macroeconomics, chapter 6, pages 139-164, Edward Elgar Publishing.
    6. Giovanni Angelini & Giovanni Caggiano & Efrem Castelnuovo & Luca Fanelli, 2023. "Are Fiscal Multipliers Estimated with Proxy‐SVARs Robust?," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 85(1), pages 95-122, February.
    7. Virkola, Tuomo, 2014. "Exchange Rate Regime, Fiscal Foresight and the Effectiveness of Fiscal Policy in a Small Open Economy," ETLA Reports 20, The Research Institute of the Finnish Economy.
    8. Mertens, Karel & Ravn, Morten O., 2014. "A reconciliation of SVAR and narrative estimates of tax multipliers," Journal of Monetary Economics, Elsevier, vol. 68(S), pages 1-19.
    9. Niklas Ahlgren & Paul Catani, 2017. "Wild bootstrap tests for autocorrelation in vector autoregressive models," Statistical Papers, Springer, vol. 58(4), pages 1189-1216, December.
    10. Herrera, Ana María & Rangaraju, Sandeep Kumar, 2019. "The quantitative effects of tax foresight: Not all states are equal," Journal of Economic Dynamics and Control, Elsevier, vol. 107(C), pages 1-1.
    11. Allan W. Gregory & James McNeil & Gregor W. Smith, 2022. "US Fiscal Policy Shocks: Proxy-SVAR Overidentification via GMM," Working Paper 1461, Economics Department, Queen's University.
    12. Laumer, Sebastian, 2020. "Government spending and heterogeneous consumption dynamics," Journal of Economic Dynamics and Control, Elsevier, vol. 114(C).
    13. Karel Mertens & Morten O. Ravn, 2012. "Empirical Evidence on the Aggregate Effects of Anticipated and Unanticipated US Tax Policy Shocks," American Economic Journal: Economic Policy, American Economic Association, vol. 4(2), pages 145-181, May.
    14. Valerie A. Ramey, 2019. "Ten Years after the Financial Crisis: What Have We Learned from the Renaissance in Fiscal Research?," Journal of Economic Perspectives, American Economic Association, vol. 33(2), pages 89-114, Spring.
    15. Jesús Fernández-Villaverde & Pablo Guerrón-Quintana & Keith Kuester & Juan Rubio-Ramírez, 2015. "Fiscal Volatility Shocks and Economic Activity," American Economic Review, American Economic Association, vol. 105(11), pages 3352-3384, November.
    16. Désirée I. Christofzik & Angela Fuest & Robin Jessen, 2022. "Macroeconomic Effects of the Anticipation and Implementation of Tax Changes in Germany: Evidence from a Narrative Account," Economica, London School of Economics and Political Science, vol. 89(353), pages 62-81, January.
    17. Karel Mertens & Morten O. Ravn, 2013. "The Dynamic Effects of Personal and Corporate Income Tax Changes in the United States," American Economic Review, American Economic Association, vol. 103(4), pages 1212-1247, June.
    18. Choi, Sangyup & Shin, Junhyeok, 2023. "Household indebtedness and the macroeconomic effects of tax changes," Journal of Economic Behavior & Organization, Elsevier, vol. 209(C), pages 22-52.
    19. James Cloyne & Nicholas Dimsdale & Natacha Postel-Vinay, 2018. "Taxes and Growth: New Narrative Evidence from Interwar Britain," NBER Working Papers 24659, National Bureau of Economic Research, Inc.
    20. Mumtaz, Haroon & Theodoridis, Konstantinos, 2020. "Fiscal policy shocks and stock prices in the United States," European Economic Review, Elsevier, vol. 129(C).

    More about this item

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C32 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes; State Space Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • E62 - Macroeconomics and Monetary Economics - - Macroeconomic Policy, Macroeconomic Aspects of Public Finance, and General Outlook - - - Fiscal Policy; Modern Monetary Theory

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:unm:umagsb:2017022. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Andrea Willems or Leonne Portz (email available below). General contact details of provider: https://edirc.repec.org/data/meteonl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.