IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/106227.html
   My bibliography  Save this paper

Wild Bootstrap for Instrumental Variables Regression with Weak Instruments and Few Clusters

Author

Listed:
  • Wang, Wenjie

Abstract

Under a framework with a small number of clusters but large numbers of observations per cluster for instrumental variable (IV) regression, we show that an unstudentized wild bootstrap test based on IV estimators such as the two-stage least squares estimator is valid as long as the instruments are strong for at least one cluster. This is different from alternative methods proposed in the literature for inference with a small number of clusters, whose validity would require that the instruments be strong for all clusters. Moreover, for the leading case in empirical applications with a single instrument, the unstudentized wild bootstrap test generated by our procedure is fully robust to weak instrument in the sense that its limiting null rejection probability is no greater than the nominal level even if all clusters are ``weak". However, such robustness is not shared by its studentized version; the wild bootstrap test that is based on the t-test statistic can have serious size distortion in this case. Furthermore, in the general case with multiple instruments, we show that an unstudentized version of bootstrap Anderson-Rubin (AR) test is fully robust to weak instruments, and is superior with regard to both size and power properties to alternative asymptotic and bootstrap AR tests that employ cluster-robust variance estimators. By contrast, we �find that bootstrapping other weak-instrument-robust tests such as the Lagrange multiplier test and the conditional quasi-likelihood ratio test, no matter studentized or unstudentized, does not guarantee correct limiting null rejection probability when all clusters are ``weak".

Suggested Citation

  • Wang, Wenjie, 2021. "Wild Bootstrap for Instrumental Variables Regression with Weak Instruments and Few Clusters," MPRA Paper 106227, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:106227
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/106227/1/MPRA_paper_106227.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Moreira, Humberto & Moreira, Marcelo J., 2019. "Optimal two-sided tests for instrumental variables regression with heteroskedastic and autocorrelated errors," Journal of Econometrics, Elsevier, vol. 213(2), pages 398-433.
    2. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2021. "Wild Bootstrap and Asymptotic Inference With Multiway Clustering," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 505-519, March.
    3. Rothenberg, Thomas J., 1984. "Approximating the distributions of econometric estimators and test statistics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 15, pages 881-935, Elsevier.
    4. Chernozhukov, Victor & Hansen, Christian, 2008. "The reduced form: A simple approach to inference with weak instruments," Economics Letters, Elsevier, vol. 100(1), pages 68-71, July.
    5. Djogbenou, Antoine A. & MacKinnon, James G. & Nielsen, Morten Ørregaard, 2019. "Asymptotic theory and wild bootstrap inference with clustered errors," Journal of Econometrics, Elsevier, vol. 212(2), pages 393-412.
    6. Karthik Muralidharan & Paul Niehaus & Sandip Sukhtankar, 2016. "Building State Capacity: Evidence from Biometric Smartcards in India," American Economic Review, American Economic Association, vol. 106(10), pages 2895-2929, October.
    7. Isaiah Andrews & Anna Mikusheva, 2016. "Conditional Inference With a Functional Nuisance Parameter," Econometrica, Econometric Society, vol. 84, pages 1571-1612, July.
    8. Whitney K. Newey & Frank Windmeijer, 2009. "Generalized Method of Moments With Many Weak Moment Conditions," Econometrica, Econometric Society, vol. 77(3), pages 687-719, May.
    9. Abel Brodeur & Nikolai Cook & Anthony Heyes, 2020. "Methods Matter: p-Hacking and Publication Bias in Causal Analysis in Economics," American Economic Review, American Economic Association, vol. 110(11), pages 3634-3660, November.
    10. Marcelo J. Moreira, 2003. "A Conditional Likelihood Ratio Test for Structural Models," Econometrica, Econometric Society, vol. 71(4), pages 1027-1048, July.
    11. Moreira, Marcelo J. & Porter, Jack R. & Suarez, Gustavo A., 2009. "Bootstrap validity for the score test when instruments may be weak," Journal of Econometrics, Elsevier, vol. 149(1), pages 52-64, April.
    12. Jerry A. Hausman & Whitney K. Newey & Tiemen Woutersen & John C. Chao & Norman R. Swanson, 2012. "Instrumental variable estimation with heteroskedasticity and many instruments," Quantitative Economics, Econometric Society, vol. 3(2), pages 211-255, July.
    13. Kaffo, Maximilien & Wang, Wenjie, 2017. "On bootstrap validity for specification testing with many weak instruments," Economics Letters, Elsevier, vol. 157(C), pages 107-111.
    14. Antoine A. Djogbenou & James G. MacKinnon & Morten Orregard Nielsen, 2018. "Asymptotic Theory and Wild Bootstrap Inference with Clustered Errors," Working Papers 1399, Queen's University, Department of Economics.
    15. Donald W. K. Andrews & Patrik Guggenberger, 2015. "Identification- and Singularity-Robust Inference for Moment Condition," Cowles Foundation Discussion Papers 1978, Cowles Foundation for Research in Economics, Yale University.
    16. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    17. David Roodman & James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2019. "Fast and wild: Bootstrap inference in Stata using boottest," Stata Journal, StataCorp LP, vol. 19(1), pages 4-60, March.
    18. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    19. Russell Davidson & James G. MacKinnon, 2014. "Bootstrap Confidence Sets with Weak Instruments," Econometric Reviews, Taylor & Francis Journals, vol. 33(5-6), pages 651-675, August.
    20. Donald W. K. Andrews & Patrik Guggenberger, 2019. "Identification‐ and singularity‐robust inference for moment condition models," Quantitative Economics, Econometric Society, vol. 10(4), pages 1703-1746, November.
    21. Wang, Wenjie & Kaffo, Maximilien, 2016. "Bootstrap inference for instrumental variable models with many weak instruments," Journal of Econometrics, Elsevier, vol. 192(1), pages 231-268.
    22. José Luis Montiel Olea & Carolin Pflueger, 2013. "A Robust Test for Weak Instruments," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 31(3), pages 358-369, July.
    23. Andreas Hagemann, 2019. "Permutation inference with a finite number of heterogeneous clusters," Papers 1907.01049, arXiv.org, revised Feb 2023.
    24. Rustam Ibragimov & Ulrich K. Müller, 2016. "Inference with Few Heterogeneous Clusters," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 83-96, March.
    25. Wang, Wenjie, 2020. "On the inconsistency of nonparametric bootstraps for the subvector Anderson–Rubin test," Economics Letters, Elsevier, vol. 191(C).
    26. Hansen, Bruce E. & Lee, Seojeong, 2019. "Asymptotic theory for clustered samples," Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
    27. Guido W. Imbens & Paul R. Rosenbaum, 2005. "Robust, accurate confidence intervals with a weak instrument: quarter of birth and education," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(1), pages 109-126, January.
    28. John C. Chao & Norman R. Swanson, 2005. "Consistent Estimation with a Large Number of Weak Instruments," Econometrica, Econometric Society, vol. 73(5), pages 1673-1692, September.
    29. Davidson, Russell & MacKinnon, James G., 2010. "Wild Bootstrap Tests for IV Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(1), pages 128-144.
    30. Frank Kleibergen, 2002. "Pivotal Statistics for Testing Structural Parameters in Instrumental Variables Regression," Econometrica, Econometric Society, vol. 70(5), pages 1781-1803, September.
    31. Chernozhukov, Victor & Hansen, Christian, 2008. "Instrumental variable quantile regression: A robust inference approach," Journal of Econometrics, Elsevier, vol. 142(1), pages 379-398, January.
    32. James G. MacKinnon & Matthew D. Webb, 2017. "Wild Bootstrap Inference for Wildly Different Cluster Sizes," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 233-254, March.
    33. Angrist, J D & Imbens, G W & Krueger, A B, 1999. "Jackknife Instrumental Variables Estimation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 14(1), pages 57-67, Jan.-Feb..
    34. Frank Kleibergen, 2005. "Testing Parameters in GMM Without Assuming that They Are Identified," Econometrica, Econometric Society, vol. 73(4), pages 1103-1123, July.
    35. Patrik Guggenberger & Frank Kleibergen & Sophocles Mavroeidis & Linchun Chen, 2012. "On the Asymptotic Sizes of Subset Anderson–Rubin and Lagrange Multiplier Tests in Linear Instrumental Variables Regression," Econometrica, Econometric Society, vol. 80(6), pages 2649-2666, November.
    36. Isaiah Andrews & Anna Mikusheva, 2016. "Conditional Inference With a Functional Nuisance Parameter," Econometrica, Econometric Society, vol. 84(4), pages 1571-1612, July.
    37. Keith Finlay & Leandro M. Magnusson, 2009. "Implementing weak-instrument robust tests for a general class of instrumental-variables models," Stata Journal, StataCorp LP, vol. 9(3), pages 398-421, September.
    38. Bekker, Paul A, 1994. "Alternative Approximations to the Distributions of Instrumental Variable Estimators," Econometrica, Econometric Society, vol. 62(3), pages 657-681, May.
    39. Russell Davidson & James G. MacKinnon, 2008. "Bootstrap inference in a linear equation estimated by instrumental variables," Econometrics Journal, Royal Economic Society, vol. 11(3), pages 443-477, November.
    40. Ivan A. Canay & Joseph P. Romano & Azeem M. Shaikh, 2017. "Randomization Tests Under an Approximate Symmetry Assumption," Econometrica, Econometric Society, vol. 85, pages 1013-1030, May.
    41. Douglas Staiger & James H. Stock, 1997. "Instrumental Variables Regression with Weak Instruments," Econometrica, Econometric Society, vol. 65(3), pages 557-586, May.
    42. Wang, Wenjie & Doko Tchatoka, Firmin, 2018. "On Bootstrap inconsistency and Bonferroni-based size-correction for the subset Anderson–Rubin test under conditional homoskedasticity," Journal of Econometrics, Elsevier, vol. 207(1), pages 188-211.
    43. Chao, John C. & Swanson, Norman R. & Hausman, Jerry A. & Newey, Whitney K. & Woutersen, Tiemen, 2012. "Asymptotic Distribution Of Jive In A Heteroskedastic Iv Regression With Many Instruments," Econometric Theory, Cambridge University Press, vol. 28(1), pages 42-86, February.
    44. Isaiah Andrews & James H. Stock & Liyang Sun, 2019. "Weak Instruments in Instrumental Variables Regression: Theory and Practice," Annual Review of Economics, Annual Reviews, vol. 11(1), pages 727-753, August.
    45. Patrik Guggenberger & Frank Kleibergen & Sophocles Mavroeidis, 2019. "A more powerful subvector Anderson Rubin test in linear instrumental variables regression," Quantitative Economics, Econometric Society, vol. 10(2), pages 487-526, May.
    46. Phillips, Garry D A & Hale, C, 1977. "The Bias of Instrumental Variable Estimators of Simultaneous Equation Systems," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 18(1), pages 219-228, February.
    47. Bester, C. Alan & Conley, Timothy G. & Hansen, Christian B., 2011. "Inference with dependent data using cluster covariance estimators," Journal of Econometrics, Elsevier, vol. 165(2), pages 137-151.
    48. Keith Finlay & Leandro M. Magnusson, 2019. "Two applications of wild bootstrap methods to improve inference in cluster‐IV models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(6), pages 911-933, September.
    49. Isaiah Andrews, 2018. "Valid Two-Step Identification-Robust Confidence Sets for GMM," The Review of Economics and Statistics, MIT Press, vol. 100(2), pages 337-348, May.
    50. Isaiah Andrews, 2016. "Conditional Linear Combination Tests for Weakly Identified Models," Econometrica, Econometric Society, vol. 84, pages 2155-2182, November.
    51. Ibragimov, Rustam & Müller, Ulrich K., 2010. "t-Statistic Based Correlation and Heterogeneity Robust Inference," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(4), pages 453-468.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    2. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    3. MacKinnon, James G., 2023. "Fast cluster bootstrap methods for linear regression models," Econometrics and Statistics, Elsevier, vol. 26(C), pages 52-71.
    4. Vincent Munley & Abian Garcia-Rodriguez & Paul Redmond, 2023. "The impact of voter turnout on referendum outcomes: evidence from Ireland," Public Choice, Springer, vol. 194(3), pages 369-393, March.
    5. Yawen Cheng & Dongmin Kong, 2023. "Educational Investment for Future Marriage? Evidence of Missing Girls from China," China & World Economy, Institute of World Economics and Politics, Chinese Academy of Social Sciences, vol. 31(4), pages 173-199, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wenjie Wang & Yichong Zhang, 2021. "Wild Bootstrap for Instrumental Variables Regressions with Weak and Few Clusters," Papers 2108.13707, arXiv.org, revised Jan 2024.
    2. Dennis Lim & Wenjie Wang & Yichong Zhang, 2022. "A Conditional Linear Combination Test with Many Weak Instruments," Papers 2207.11137, arXiv.org, revised Apr 2023.
    3. Wang, Wenjie & Kaffo, Maximilien, 2016. "Bootstrap inference for instrumental variable models with many weak instruments," Journal of Econometrics, Elsevier, vol. 192(1), pages 231-268.
    4. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Size-corrected Bootstrap Test after Pretesting for Exogeneity with Heteroskedastic or Clustered Data," MPRA Paper 110899, University Library of Munich, Germany.
    5. Antoine, Bertille & Lavergne, Pascal, 2023. "Identification-robust nonparametric inference in a linear IV model," Journal of Econometrics, Elsevier, vol. 235(1), pages 1-24.
    6. MacKinnon, James G., 2023. "Fast cluster bootstrap methods for linear regression models," Econometrics and Statistics, Elsevier, vol. 26(C), pages 52-71.
    7. Johannes W. Ligtenberg, 2023. "Inference in IV models with clustered dependence, many instruments and weak identification," Papers 2306.08559, arXiv.org, revised Mar 2024.
    8. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Cluster-robust inference: A guide to empirical practice," Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
    9. Wang, Wenjie, 2020. "On Bootstrap Validity for the Test of Overidentifying Restrictions with Many Instruments and Heteroskedasticity," MPRA Paper 104858, University Library of Munich, Germany.
    10. Wang, Wenjie & Doko Tchatoka, Firmin, 2018. "On Bootstrap inconsistency and Bonferroni-based size-correction for the subset Anderson–Rubin test under conditional homoskedasticity," Journal of Econometrics, Elsevier, vol. 207(1), pages 188-211.
    11. Keith Finlay & Leandro M. Magnusson, 2019. "Two applications of wild bootstrap methods to improve inference in cluster‐IV models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 34(6), pages 911-933, September.
    12. Murray Michael P., 2017. "Linear Model IV Estimation When Instruments Are Many or Weak," Journal of Econometric Methods, De Gruyter, vol. 6(1), pages 1-22, January.
    13. Horowitz, Joel L., 2021. "Bounding the difference between true and nominal rejection probabilities in tests of hypotheses about instrumental variables models," Journal of Econometrics, Elsevier, vol. 222(2), pages 1057-1082.
    14. Marcelo Moreira & Geert Ridder, 2019. "Efficiency loss of asymptotically efficient tests in an instrumental variables regression," CeMMAP working papers CWP03/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    15. Purevdorj Tuvaandorj, 2021. "Robust Permutation Tests in Linear Instrumental Variables Regression," Papers 2111.13774, arXiv.org, revised Jun 2023.
    16. James G. MacKinnon, 2019. "How cluster-robust inference is changing applied econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 52(3), pages 851-881, August.
    17. Andrews, Donald W.K. & Cheng, Xu & Guggenberger, Patrik, 2020. "Generic results for establishing the asymptotic size of confidence sets and tests," Journal of Econometrics, Elsevier, vol. 218(2), pages 496-531.
    18. Doko Tchatoka, Firmin & Wang, Wenjie, 2021. "Uniform Inference after Pretesting for Exogeneity with Heteroskedastic Data," MPRA Paper 106408, University Library of Munich, Germany.
    19. MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023. "Testing for the appropriate level of clustering in linear regression models," Journal of Econometrics, Elsevier, vol. 235(2), pages 2027-2056.
    20. James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.

    More about this item

    Keywords

    Weak Instrument; Wild Bootstrap; Clustered Data; Randomization Test;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C26 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Instrumental Variables (IV) Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:106227. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.