Advanced Search
MyIDEAS: Login

Reworking Wild Bootstrap Based Inference for Clustered Errors

Contents:

Author Info

  • Matthew D. Webb

    ()
    (University of Calgary)

Abstract

Many empirical projects are well suited to incorporating a linear difference-in-differences research design. While estimation is straightforward, reliable inference can be a challenge. Past research has not only demonstrated that estimated standard errors are biased dramatically downwards in models possessing a group clustered design, but has also suggested a number of bootstrap-based improvements to the inference procedure. In this paper, I first demonstrate using Monte Carlo experiments, that these bootstrap-based procedures and traditional cluster-robust standard errors perform poorly in situations with fewer than eleven clusters - a setting faced in many empirical applications. With few clusters, the wild cluster bootstrap-t procedure results in p-values that are not point identified. I subsequently introduce two easy-to-implement alternative procedures that involve the wild bootstrap. Further Monte Carlo simulations provide evidence that the use of a 6-point distribution with the wild bootstrap can improve the reliability of inference.

Download Info

If you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
File URL: http://qed.econ.queensu.ca/working_papers/papers/qed_wp_1315.pdf
File Function: First version 2013
Download Restriction: no

Bibliographic Info

Paper provided by Queen's University, Department of Economics in its series Working Papers with number 1315.

as in new window
Length: 21 pages
Date of creation: Aug 2013
Date of revision:
Handle: RePEc:qed:wpaper:1315

Contact details of provider:
Postal: Kingston, Ontario, K7L 3N6
Phone: (613) 533-2250
Fax: (613) 533-6668
Email:
Web page: http://qed.econ.queensu.ca/
More information through EDIRC

Related research

Keywords: CRVE; grouped data; clustered data; panel data; wild bootstrap; cluster wild bootstrap; difference in differences; placebo laws;

Find related papers by JEL classification:

This paper has been announced in the following NEP Reports:

References

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
as in new window
  1. Gruber, J. & Poterba, J., 1994. "Tax Incentives and the Decision to Purchase Health Insurance: Evidence from the Self-Employed," Working papers 94-10, Massachusetts Institute of Technology (MIT), Department of Economics.
  2. James G. MacKinnon & Matthew D. Webb, 2014. "Wild Bootstrap Inference for Wildly Different Cluster Sizes," Working Papers 1314, Queen's University, Department of Economics.
  3. Bruce D. Meyer, 1994. "Natural and Quasi- Experiments in Economics," NBER Technical Working Papers 0170, National Bureau of Economic Research, Inc.
  4. David Card & Alan B. Krueger, 1993. "Minimum Wages and Employment: A Case Study of the Fast Food Industry in New Jersey and Pennsylvania," NBER Working Papers 4509, National Bureau of Economic Research, Inc.
  5. A. Colin Cameron & Douglas L. Miller, 2010. "Robust Inference with Clustered Data," Working Papers 107, University of California, Davis, Department of Economics.
  6. Kloek, T, 1981. "OLS Estimation in a Model Where a Microvariable Is Explained by Aggregates and Contemporaneous Disturbances Are Equicorrelated," Econometrica, Econometric Society, vol. 49(1), pages 205-07, January.
  7. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2007. "Bootstrap-Based Improvements for Inference with Clustered Errors," NBER Technical Working Papers 0344, National Bureau of Economic Research, Inc.
  8. Stephen G. Donald & Kevin Lang, 2007. "Inference with Difference-in-Differences and Other Panel Data," The Review of Economics and Statistics, MIT Press, vol. 89(2), pages 221-233, May.
  9. DiNardo, John & Lee, David S., 2011. "Program Evaluation and Research Designs," Handbook of Labor Economics, Elsevier.
  10. Nada Eissa & Jeffrey B. Liebman, 1995. "Labor Supply Response to the Earned Income Tax Credit," NBER Working Papers 5158, National Bureau of Economic Research, Inc.
  11. Abadie, Alberto & Diamond, Alexis & Hainmueller, Jens, 2010. "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California’s Tobacco Control Program," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 493-505.
  12. Ibragimov, Rustam & Müller, Ulrich K., 2010. "t-Statistic Based Correlation and Heterogeneity Robust Inference," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(4), pages 453-468.
  13. Russell Davidson & Emmanuel Flachaire, 2000. "The Wild Bootstrap, Tamed at Last," Econometric Society World Congress 2000 Contributed Papers 1413, Econometric Society.
  14. William Rogers, 1994. "Regression standard errors in clustered samples," Stata Technical Bulletin, StataCorp LP, vol. 3(13).
  15. Bester, C. Alan & Conley, Timothy G. & Hansen, Christian B., 2011. "Inference with dependent data using cluster covariance estimators," Journal of Econometrics, Elsevier, vol. 165(2), pages 137-151.
  16. Timothy Conley & Christopher Taber, 2005. "Inference with "Difference in Differences" with a Small Number of Policy Changes," NBER Technical Working Papers 0312, National Bureau of Economic Research, Inc.
  17. Alberto Abadie, 2005. "Semiparametric Difference-in-Differences Estimators," Review of Economic Studies, Oxford University Press, vol. 72(1), pages 1-19.
  18. Thompson, Samuel B., 2011. "Simple formulas for standard errors that cluster by both firm and time," Journal of Financial Economics, Elsevier, vol. 99(1), pages 1-10, January.
  19. Jeffrey M. Wooldridge, 2003. "Cluster-Sample Methods in Applied Econometrics," American Economic Review, American Economic Association, vol. 93(2), pages 133-138, May.
Full references (including those not matched with items on IDEAS)

Citations

Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
as in new window

Cited by:
  1. Brewer, Mike & Crossley, Thomas F. & Joyce, Robert, 2013. "Inference with Difference-in-Differences Revisited," IZA Discussion Papers 7742, Institute for the Study of Labor (IZA).
  2. Makram El-Shagi & Claus Michelsen & Sebastian Rosenschon, 2014. "Regulation, Innovation and Technology Diffusion: Evidence from Building Energy Efficiency Standards in Germany," Discussion Papers of DIW Berlin 1371, DIW Berlin, German Institute for Economic Research.
  3. James G. MacKinnon & Matthew D. Webb, 2014. "Wild Bootstrap Inference for Wildly Different Cluster Sizes," Working Papers 1314, Queen's University, Department of Economics.

Lists

This item is not listed on Wikipedia, on a reading list or among the top items on IDEAS.

Statistics

Access and download statistics

Corrections

When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1315. See general information about how to correct material in RePEc.

For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Babcock).

If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

If references are entirely missing, you can add them using this form.

If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.

If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.

Please note that corrections may take a couple of weeks to filter through the various RePEc services.