Placebo inference on treatment effects when the number of clusters is small
Author
Abstract
Suggested Citation
DOI: 10.1016/j.jeconom.2019.04.011
Download full text from publisher
As the access to this document is restricted, you may want to search for a different version of it.
References listed on IDEAS
- repec:clg:wpaper:2013-20 is not listed on IDEAS
- Andrew V. Carter & Kevin T. Schnepel & Douglas G. Steigerwald, 2017. "Asymptotic Behavior of a t -Test Robust to Cluster Heterogeneity," The Review of Economics and Statistics, MIT Press, vol. 99(4), pages 698-709, July.
- Stephen G. Donald & Kevin Lang, 2007. "Inference with Difference-in-Differences and Other Panel Data," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 221-233, May.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008.
"Bootstrap-Based Improvements for Inference with Clustered Errors,"
The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
- Jonah B. Gelbach & Doug Miller & A. Colin Cameron, 2006. "Bootstrap-Based Improvements for Inference with Clustered Errors," Working Papers 128, University of California, Davis, Department of Economics.
- A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2007. "Bootstrap-Based Improvements for Inference with Clustered Errors," NBER Technical Working Papers 0344, National Bureau of Economic Research, Inc.
- A. Colin Cameron & Douglas L. Miller, 2015. "A Practitioner’s Guide to Cluster-Robust Inference," Journal of Human Resources, University of Wisconsin Press, vol. 50(2), pages 317-372.
- Xiong, Shifeng & Li, Guoying, 2008. "Some results on the convergence of conditional distributions," Statistics & Probability Letters, Elsevier, vol. 78(18), pages 3249-3253, December.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005.
"A New Asymptotic Theory For Heteroskedasticity-Autocorrelation Robust Tests,"
Econometric Theory, Cambridge University Press, vol. 21(6), pages 1130-1164, December.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2005. "A New Asymptotic Theory for Heteroskedasticity-Autocorrelation Robust Tests," Working Papers 05-08, Cornell University, Center for Analytic Economics.
- James G. MacKinnon & Matthew D. Webb, 2018.
"The wild bootstrap for few (treated) clusters,"
Econometrics Journal, Royal Economic Society, vol. 21(2), pages 114-135, June.
- James G. MacKinnon & Matthew D. Webb, 2017. "The Wild Bootstrap For Few (treated) Clusters," Working Paper 1364, Economics Department, Queen's University.
- Rustam Ibragimov & Ulrich K. Müller, 2016. "Inference with Few Heterogeneous Clusters," The Review of Economics and Statistics, MIT Press, vol. 98(1), pages 83-96, March.
- El Machkouri, Mohamed & Volný, Dalibor & Wu, Wei Biao, 2013. "A central limit theorem for stationary random fields," Stochastic Processes and their Applications, Elsevier, vol. 123(1), pages 1-14.
- Kiefer, Nicholas M. & Vogelsang, Timothy J., 2002. "Heteroskedasticity-Autocorrelation Robust Testing Using Bandwidth Equal To Sample Size," Econometric Theory, Cambridge University Press, vol. 18(6), pages 1350-1366, December.
- Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004.
"How Much Should We Trust Differences-In-Differences Estimates?,"
The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 119(1), pages 249-275.
- Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2002. "How Much Should We Trust Differences-in-Differences Estimates?," NBER Working Papers 8841, National Bureau of Economic Research, Inc.
- Janssen, Arnold, 1997. "Studentized permutation tests for non-i.i.d. hypotheses and the generalized Behrens-Fisher problem," Statistics & Probability Letters, Elsevier, vol. 36(1), pages 9-21, November.
- Matthew D. Webb, 2023.
"Reworking wild bootstrap‐based inference for clustered errors,"
Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 56(3), pages 839-858, August.
- Matthew D. Webb, 2014. "Reworking Wild Bootstrap Based Inference For Clustered Errors," Working Paper 1315, Economics Department, Queen's University.
- Ivan A. Canay & Joseph P. Romano & Azeem M. Shaikh, 2017. "Randomization Tests Under an Approximate Symmetry Assumption," Econometrica, Econometric Society, vol. 85, pages 1013-1030, May.
- Hansen, Christian B., 2007. "Asymptotic properties of a robust variance matrix estimator for panel data when T is large," Journal of Econometrics, Elsevier, vol. 141(2), pages 597-620, December.
- Kloek, T, 1981. "OLS Estimation in a Model Where a Microvariable Is Explained by Aggregates and Contemporaneous Disturbances Are Equicorrelated," Econometrica, Econometric Society, vol. 49(1), pages 205-207, January.
- Bester, C. Alan & Conley, Timothy G. & Hansen, Christian B., 2011. "Inference with dependent data using cluster covariance estimators," Journal of Econometrics, Elsevier, vol. 165(2), pages 137-151.
- Arnold Janssen, 2005. "Resampling student'st-type statistics," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 57(3), pages 507-529, September.
- Horowitz, Joel L, 1992. "A Smoothed Maximum Score Estimator for the Binary Response Model," Econometrica, Econometric Society, vol. 60(3), pages 505-531, May.
- Ibragimov, Rustam & Müller, Ulrich K., 2010. "t-Statistic Based Correlation and Heterogeneity Robust Inference," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(4), pages 453-468.
- Moulton, Brent R, 1990. "An Illustration of a Pitfall in Estimating the Effects of Aggregate Variables on Micro Unit," The Review of Economics and Statistics, MIT Press, vol. 72(2), pages 334-338, May.
Citations
Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
Cited by:
- MacKinnon, James G. & Webb, Matthew D., 2020.
"Randomization inference for difference-in-differences with few treated clusters,"
Journal of Econometrics, Elsevier, vol. 218(2), pages 435-450.
- James G. MacKinnon & Matthew D. Webb, 2016. "Randomization Inference for Difference-in-Differences with Few Treated Clusters," Carleton Economic Papers 16-11, Carleton University, Department of Economics.
- James G. MacKinnon & Matthew D. Webb, 2019. "Randomization Inference For Difference-in-differences With Few Treated Clusters," Working Paper 1355, Economics Department, Queen's University.
- Hao Wang & Tao Zhang & Xi Wang, 2024. "High-speed railways reduces carbon emissions: mediating effects of green innovation and the resilience of environmental investment," Palgrave Communications, Palgrave Macmillan, vol. 11(1), pages 1-24, December.
- Kojevnikov, Denis & Song, Kyungchul, 2023. "Some impossibility results for inference with cluster dependence with large clusters," Other publications TiSEM 80b8e4ed-54bc-4a34-883f-f, Tilburg University, School of Economics and Management.
- Kevin Lang & Kaiwen Leong & Huailu Li & Haibo Xu, 2019.
"Lending to the Unbanked: Relational Contracting with Loan Sharks,"
NBER Working Papers
26400, National Bureau of Economic Research, Inc.
- Lang, Kevin & Leong, Kaiwen & Li, Huailu & Xu, Haibo, 2020. "Lending to the Unbanked: Relational Contracting with Loan Sharks," IZA Discussion Papers 13360, Institute of Labor Economics (IZA).
- Kevin Lang & Kaiwen Leong & Huailu Li & Haibo Xu, 2020. "Lending to the Unbanked: Relational Contracting with Loan Sharks," Boston University - Department of Economics - The Institute for Economic Development Working Papers Series dp-338, Boston University - Department of Economics.
- Rik Chakraborti & Gavin Roberts, 2023. "How price-gouging regulation undermined COVID-19 mitigation: county-level evidence of unintended consequences," Public Choice, Springer, vol. 196(1), pages 51-83, July.
- Wang, Wenjie & Zhang, Yichong, 2024. "Wild bootstrap inference for instrumental variables regressions with weak and few clusters," Journal of Econometrics, Elsevier, vol. 241(1).
- MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023.
"Cluster-robust inference: A guide to empirical practice,"
Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
- Matthew D. Webb & James MacKinnon & Morten Nielsen, 2021. "Cluster–robust inference: A guide to empirical practice," Economics Virtual Symposium 2021 6, Stata Users Group.
- James G. MacKinnon & Morten {O}rregaard Nielsen & Matthew D. Webb, 2022. "Cluster-Robust Inference: A Guide to Empirical Practice," Papers 2205.03285, arXiv.org.
- James MacKinnon & Morten Ørregaard Nielsen, 2022. "Cluster-Robust Inference: A Guide to Empirical Practice," CREATES Research Papers 2022-08, Department of Economics and Business Economics, Aarhus University.
- James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2022. "Cluster-Robust Inference: A Guide to Empirical Practice," Working Paper 1456, Economics Department, Queen's University.
- Kojevnikov, Denis & Song, Kyungchul, 2023. "Some impossibility results for inference with cluster dependence with large clusters," Journal of Econometrics, Elsevier, vol. 237(2).
- Hwang, Jungbin, 2021. "Simple and trustworthy cluster-robust GMM inference," Journal of Econometrics, Elsevier, vol. 222(2), pages 993-1023.
- Kevin Lang, 2020. "Effort and wages: Evidence from the payroll tax," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 53(1), pages 108-139, February.
- James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
- Felipe Lozano‐Rojas & Patrick Carlin, 2022. "The effect of soda taxes beyond beverages in Philadelphia," Health Economics, John Wiley & Sons, Ltd., vol. 31(11), pages 2381-2410, November.
- Bruno Ferman, 2023.
"Inference in difference‐in‐differences: How much should we trust in independent clusters?,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 38(3), pages 358-369, April.
- Ferman, Bruno, 2019. "Inference in Differences-in-Differences: How Much Should We Trust in Independent Clusters?," MPRA Paper 93746, University Library of Munich, Germany.
- Bruno Ferman, 2019. "Inference in Difference-in-Differences: How Much Should We Trust in Independent Clusters?," Papers 1909.01782, arXiv.org, revised Sep 2022.
- Yingfei Mu & Edward A. Rubin & Eric Zou, 2021. "What’s Missing in Environmental (Self-)Monitoring: Evidence from Strategic Shutdowns of Pollution Monitors," NBER Working Papers 28735, National Bureau of Economic Research, Inc.
- Andreas Hagemann, 2019. "Permutation inference with a finite number of heterogeneous clusters," Papers 1907.01049, arXiv.org, revised Feb 2023.
- Brantly Callaway, 2022. "Difference-in-Differences for Policy Evaluation," Papers 2203.15646, arXiv.org.
- Dao, Chi Danh & Fenig, Guidon & Sator, Georg & Yoon, Jin Young, 2024. "Assessing Robustness to Varying Clustering Methods and Samples in Ambuehl, Bernheim, and Lusardi (2022): Replication and Sensitivity Analysis," I4R Discussion Paper Series 110, The Institute for Replication (I4R).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Andreas Hagemann, 2019. "Permutation inference with a finite number of heterogeneous clusters," Papers 1907.01049, arXiv.org, revised Feb 2023.
- Hansen, Bruce E. & Lee, Seojeong, 2019.
"Asymptotic theory for clustered samples,"
Journal of Econometrics, Elsevier, vol. 210(2), pages 268-290.
- Bruce E. Hansen & Seojeong Jay Lee, 2017. "Asymptotic Theory for Clustered Samples," Discussion Papers 2017-18, School of Economics, The University of New South Wales.
- Bruce E. Hansen & Seojeong Lee, 2019. "Asymptotic Theory for Clustered Samples," Papers 1902.01497, arXiv.org.
- MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023.
"Cluster-robust inference: A guide to empirical practice,"
Journal of Econometrics, Elsevier, vol. 232(2), pages 272-299.
- Matthew D. Webb & James MacKinnon & Morten Nielsen, 2021. "Cluster–robust inference: A guide to empirical practice," Economics Virtual Symposium 2021 6, Stata Users Group.
- James MacKinnon & Morten Ørregaard Nielsen, 2022. "Cluster-Robust Inference: A Guide to Empirical Practice," CREATES Research Papers 2022-08, Department of Economics and Business Economics, Aarhus University.
- James G. MacKinnon & Morten {O}rregaard Nielsen & Matthew D. Webb, 2022. "Cluster-Robust Inference: A Guide to Empirical Practice," Papers 2205.03285, arXiv.org.
- James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2022. "Cluster-Robust Inference: A Guide to Empirical Practice," Working Paper 1456, Economics Department, Queen's University.
- James G. MacKinnon & Matthew D. Webb, 2020. "When and How to Deal with Clustered Errors in Regression Models," Working Paper 1421, Economics Department, Queen's University.
- Matthew D. Webb, 2023.
"Reworking wild bootstrap‐based inference for clustered errors,"
Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 56(3), pages 839-858, August.
- Matthew D. Webb, 2014. "Reworking Wild Bootstrap Based Inference For Clustered Errors," Working Paper 1315, Economics Department, Queen's University.
- Hwang, Jungbin, 2021. "Simple and trustworthy cluster-robust GMM inference," Journal of Econometrics, Elsevier, vol. 222(2), pages 993-1023.
- James G. MacKinnon & Matthew D. Webb, 2017.
"Wild Bootstrap Inference for Wildly Different Cluster Sizes,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 32(2), pages 233-254, March.
- James G. MacKinnon & Matthew D. Webb, 2015. "Wild Bootstrap Inference For Wildly Different Cluster Sizes," Working Paper 1314, Economics Department, Queen's University.
- MacKinnon, James G. & Nielsen, Morten Ørregaard & Webb, Matthew D., 2023.
"Testing for the appropriate level of clustering in linear regression models,"
Journal of Econometrics, Elsevier, vol. 235(2), pages 2027-2056.
- James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2022. "Testing for the appropriate level of clustering in linear regression models," Working Paper 1428, Economics Department, Queen's University.
- James G. MacKinnon & Morten {O}rregaard Nielsen & Matthew D. Webb, 2023. "Testing for the appropriate level of clustering in linear regression models," Papers 2301.04522, arXiv.org, revised Mar 2023.
- Ivan A. Canay & Andres Santos & Azeem M. Shaikh, 2018.
"The wild bootstrap with a "small" number of "large" clusters,"
CeMMAP working papers
CWP27/18, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- Ivan A. Canay & Andres Santos & Azeem M. Shaikh, 2019. "The Wild Bootstrap with a Small Number of Large Clusters," CeMMAP working papers CWP40/19, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
- James G. MacKinnon, 2019.
"How cluster‐robust inference is changing applied econometrics,"
Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 52(3), pages 851-881, August.
- James G. MacKinnon, 2019. "How cluster-robust inference is changing applied econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 52(3), pages 851-881, August.
- James G. MacKinnon, 2019. "How cluster-robust inference is changing applied econometrics," Working Paper 1413, Economics Department, Queen's University.
- Jungbin Hwang, 2017. "Simple and Trustworthy Cluster-Robust GMM Inference," Working papers 2017-19, University of Connecticut, Department of Economics, revised Aug 2020.
- James G. MacKinnon & Matthew D. Webb, 2017. "Pitfalls When Estimating Treatment Effects Using Clustered Data," Working Paper 1387, Economics Department, Queen's University.
- Timothy Conley & Silvia Gonçalves & Christian Hansen, 2018. "Inference with Dependent Data in Accounting and Finance Applications," Journal of Accounting Research, Wiley Blackwell, vol. 56(4), pages 1139-1203, September.
- A. Colin Cameron & Douglas L. Miller, 2010.
"Robust Inference with Clustered Data,"
Working Papers
106, University of California, Davis, Department of Economics.
- Colin Cameron, 2011. "Robust inference with clustered data," Mexican Stata Users' Group Meetings 2011 07, Stata Users Group.
- A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 107, University of California, Davis, Department of Economics.
- James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2021.
"Wild Bootstrap and Asymptotic Inference With Multiway Clustering,"
Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 505-519, March.
- James G. MacKinnon & Morten Ø. Nielsen & Matthew D. Webb, 2019. "Wild Bootstrap and Asymptotic Inference with Multiway Clustering," Working Paper 1415, Economics Department, Queen's University.
- James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2020. "Wild Bootstrap and Asymptotic Inference with Multiway Clustering," CREATES Research Papers 2020-06, Department of Economics and Business Economics, Aarhus University.
- James G. MacKinnon & Morten {O}rregaard Nielsen & Matthew D. Webb, 2024.
"Cluster-robust jackknife and bootstrap inference for binary response models,"
Papers
2406.00650, arXiv.org.
- James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2024. "Cluster-Robust Jackknife and Bootstrap Inference for Binary Response Models," Working Paper 1515, Economics Department, Queen's University.
- A. Colin Cameron & Douglas L. Miller, 2010.
"Robust Inference with Clustered Data,"
Working Papers
318, University of California, Davis, Department of Economics.
- Colin Cameron, 2011. "Robust inference with clustered data," Mexican Stata Users' Group Meetings 2011 07, Stata Users Group.
- A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 316, University of California, Davis, Department of Economics.
- MacKinnon, James G. & Webb, Matthew D., 2020.
"Randomization inference for difference-in-differences with few treated clusters,"
Journal of Econometrics, Elsevier, vol. 218(2), pages 435-450.
- James G. MacKinnon & Matthew D. Webb, 2016. "Randomization Inference for Difference-in-Differences with Few Treated Clusters," Carleton Economic Papers 16-11, Carleton University, Department of Economics.
- James G. MacKinnon & Matthew D. Webb, 2019. "Randomization Inference For Difference-in-differences With Few Treated Clusters," Working Paper 1355, Economics Department, Queen's University.
- Andreas Hagemann, 2020. "Inference with a single treated cluster," Papers 2010.04076, arXiv.org.
- Andreas Hagemann, 2017. "Cluster-Robust Bootstrap Inference in Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(517), pages 446-456, January.
More about this item
Keywords
Cluster-robust inference; Randomization; Permutation;All these keywords.
JEL classification:
- C01 - Mathematical and Quantitative Methods - - General - - - Econometrics
- C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
- C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:213:y:2019:i:1:p:190-209. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.