IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2308.10138.html
   My bibliography  Save this paper

On the Inconsistency of Cluster-Robust Inference and How Subsampling Can Fix It

Author

Listed:
  • Harold D. Chiang
  • Yuya Sasaki
  • Yulong Wang

Abstract

Conventional methods of cluster-robust inference are inconsistent in the presence of unignorably large clusters. We formalize this claim by establishing a necessary and sufficient condition for the consistency of the conventional methods. We find that this condition for the consistency is rejected for a majority of empirical research papers. In this light, we propose a novel score subsampling method that achieves uniform size control over a broad class of data generating processes, covering that fails the conventional method. Simulation studies support these claims. With real data used by an empirical paper, we showcase that the conventional methods conclude significance while our proposed method concludes insignificance.

Suggested Citation

  • Harold D. Chiang & Yuya Sasaki & Yulong Wang, 2023. "On the Inconsistency of Cluster-Robust Inference and How Subsampling Can Fix It," Papers 2308.10138, arXiv.org, revised Mar 2024.
    • Handle: RePEc:arx:papers:2308.10138
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2308.10138
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037.
    2. Nicholas M. Kiefer & Timothy J. Vogelsang, 2002. "Heteroskedasticity-Autocorrelation Robust Standard Errors Using The Bartlett Kernel Without Truncation," Econometrica, Econometric Society, vol. 70(5), pages 2093-2095, September.
    3. A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
    4. Yuya Sasaki & Yulong Wang, 2022. "Non-Robustness of the Cluster-Robust Inference: with a Proposal of a New Robust Method," Papers 2210.16991, arXiv.org, revised Dec 2022.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Koo, Bonsoo & Seo, Myung Hwan, 2015. "Structural-break models under mis-specification: Implications for forecasting," Journal of Econometrics, Elsevier, vol. 188(1), pages 166-181.
    2. Matei Demetrescu & Christoph Hanck & Robinson Kruse‐Becher, 2022. "Robust inference under time‐varying volatility: A real‐time evaluation of professional forecasters," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 37(5), pages 1010-1030, August.
    3. Xu, Ke-Li, 2012. "Robustifying multivariate trend tests to nonstationary volatility," Journal of Econometrics, Elsevier, vol. 169(2), pages 147-154.
    4. Wenjie Wang & Yichong Zhang, 2021. "Wild Bootstrap for Instrumental Variables Regressions with Weak and Few Clusters," Papers 2108.13707, arXiv.org, revised Jan 2024.
    5. Sun, Yixiao, 2014. "Let’s fix it: Fixed-b asymptotics versus small-b asymptotics in heteroskedasticity and autocorrelation robust inference," Journal of Econometrics, Elsevier, vol. 178(P3), pages 659-677.
    6. Cheol-Keun Cho & Timothy J. Vogelsang, 2016. "Fixed- b Inference for Testing Structural Change in a Time Series Regression," Econometrics, MDPI, vol. 5(1), pages 1-26, December.
    7. Li, Kunpeng & Cui, Guowei & Lu, Lina, 2020. "Efficient estimation of heterogeneous coefficients in panel data models with common shocks," Journal of Econometrics, Elsevier, vol. 216(2), pages 327-353.
    8. Jen-Je Su, 2004. "Testing for no autocorrelation using a modified Lobato test," Economics Bulletin, AccessEcon, vol. 3(46), pages 1-9.
    9. Miao Wang & Hong Zhuang, 2022. "Effect of official development assistance on adolescent fertility rate: within-country evidence," Economics Bulletin, AccessEcon, vol. 42(2), pages 566-590.
    10. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    11. Jongmoo Jay Choi & Hoje Jo & Jimi Kim & Moo Sung Kim, 2018. "Business Groups and Corporate Social Responsibility," Journal of Business Ethics, Springer, vol. 153(4), pages 931-954, December.
    12. Clément de Chaisemartin & Jaime Ramirez-Cuellar, 2024. "At What Level Should One Cluster Standard Errors in Paired and Small-Strata Experiments?," American Economic Journal: Applied Economics, American Economic Association, vol. 16(1), pages 193-212, January.
    13. Francesca Carta & Lucia Rizzica, 2015. "Female employment and pre-kindergarten: on the uninteded effects of an Italian reform," Temi di discussione (Economic working papers) 1030, Bank of Italy, Economic Research and International Relations Area.
    14. Rotunno, Lorenzo, 2016. "Political stability and trade agreements: Evidence for ‘endgame FTAs’," European Journal of Political Economy, Elsevier, vol. 45(C), pages 133-148.
    15. Friedrich, Sarah & Pauly, Markus, 2018. "MATS: Inference for potentially singular and heteroscedastic MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 166-179.
    16. Nora Gordon & Sarah Reber, 2018. "The effects of school desegregation on mixed-race births," Journal of Population Economics, Springer;European Society for Population Economics, vol. 31(2), pages 561-596, April.
    17. Borisova, Ekaterina & Gründler, Klaus & Hackenberger, Armin & Harter, Anina & Potrafke, Niklas & Schoors, Koen, 2023. "Crisis experience and the deep roots of COVID-19 vaccination preferences," European Economic Review, Elsevier, vol. 160(C).
    18. Biqing Cai & Jiti Gao & Dag Tjøstheim, 2017. "A New Class of Bivariate Threshold Cointegration Models," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 35(2), pages 288-305, April.
    19. Disha Gupta, 2023. "Free power, irrigation, and groundwater depletion: Impact of farm electricity policy of Punjab, India," Agricultural Economics, International Association of Agricultural Economists, vol. 54(4), pages 515-541, July.
    20. Berthélemy Michel & Bonev Petyo & Dussaux Damien & Söderberg Magnus, 2019. "Methods for strengthening a weak instrument in the case of a persistent treatment," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 23(1), pages 1-30, February.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2308.10138. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.