IDEAS home Printed from https://ideas.repec.org/p/qed/wpaper/1406.html
   My bibliography  Save this paper

Fast and Wild: Bootstrap Inference in Stata Using boottest

Author

Listed:
  • David Roodman

    () (Open Philanthropy Project)

  • James G. MacKinnon

    () (Queen's University)

  • Morten Orregard Nielsen

    () (Queen's University)

  • Matthew D. Webb

    () (Carleton University)

Abstract

The wild bootstrap was originally developed for regression models with heteroskedasticity of unknown form. Over the past thirty years, it has been extended to models estimated by instrumental variables and maximum likelihood, and to ones where the error terms are (perhaps multi-way) clustered. Like bootstrap methods in general, the wild bootstrap is especially useful when conventional inference methods are unreliable because large-sample assumptions do not hold. For example, there may be few clusters, few treated clusters, or weak instruments. The Stata package boottest can perform a wide variety of wild bootstrap tests, often at remarkable speed. It can also invert these tests to construct confidence sets. As a postestimation command, boottest works after linear estimation commands including regress, cnsreg, ivregress, ivreg2, areg, and reghdfe, as well as many estimation commands based on maximum likelihood. Although it is designed to perform the wild cluster bootstrap, boottest can also perform the ordinary (non-clustered) version. Wrappers offer classical Wald, score/LM, and Anderson-Rubin tests, optionally with (multi-way) clustering. We review the main ideas of the wild cluster bootstrap, offer tips for use, explain why it is particularly amenable to computational optimization, state the syntax of boottest, artest, scoretest, and waldtest, and present several empirical examples for illustration.

Suggested Citation

  • David Roodman & James G. MacKinnon & Morten Orregard Nielsen & Matthew D. Webb, 2018. "Fast and Wild: Bootstrap Inference in Stata Using boottest," Working Papers 1406, Queen's University, Department of Economics.
  • Handle: RePEc:qed:wpaper:1406
    as

    Download full text from publisher

    File URL: http://qed.econ.queensu.ca/working_papers/papers/qed_wp_1406.pdf
    File Function: First version 2018
    Download Restriction: no

    References listed on IDEAS

    as
    1. repec:clg:wpaper:2013-20 is not listed on IDEAS
    2. A. Colin Cameron & Jonah B. Gelbach & Douglas L. Miller, 2008. "Bootstrap-Based Improvements for Inference with Clustered Errors," The Review of Economics and Statistics, MIT Press, vol. 90(3), pages 414-427, August.
    3. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    4. Keith Finlay & Leandro Magnusson & Mark E Schaffer, 2013. "WEAKIV: Stata module to perform weak-instrument-robust tests and confidence intervals for instrumental-variable (IV) estimation of linear, probit and tobit models," Statistical Software Components S457684, Boston College Department of Economics, revised 18 Oct 2016.
    5. Timothy G. Conley & Christopher R. Taber, 2011. "Inference with "Difference in Differences" with a Small Number of Policy Changes," The Review of Economics and Statistics, MIT Press, vol. 93(1), pages 113-125, February.
    6. Thompson, Samuel B., 2011. "Simple formulas for standard errors that cluster by both firm and time," Journal of Financial Economics, Elsevier, vol. 99(1), pages 1-10, January.
    7. Steven D. Levitt, 1996. "The Effect of Prison Population Size on Crime Rates: Evidence from Prison Overcrowding Litigation," The Quarterly Journal of Economics, Oxford University Press, vol. 111(2), pages 319-351.
    8. repec:ags:stataj:152285 is not listed on IDEAS
    9. Kline Patrick & Santos Andres, 2012. "A Score Based Approach to Wild Bootstrap Inference," Journal of Econometric Methods, De Gruyter, vol. 1(1), pages 23-41, August.
    10. Stelios Michalopoulos & Elias Papaioannou, 2013. "Pre‐Colonial Ethnic Institutions and Contemporary African Development," Econometrica, Econometric Society, vol. 81(1), pages 113-152, January.
    11. repec:tpr:restat:v:99:y:2017:i:4:p:698-709 is not listed on IDEAS
    12. Christopher F Baum & Mark E. Schaffer & Steven Stillman, 2007. "Enhanced routines for instrumental variables/GMM estimation and testing," CERT Discussion Papers 0706, Centre for Economic Reform and Transformation, Heriot Watt University.
    13. Antoine A. Djogbenou & James G. MacKinnon & Morten Orregard Nielsen, 2018. "Asymptotic Theory and Wild Bootstrap Inference with Clustered Errors," Working Papers 1399, Queen's University, Department of Economics.
    14. Jonathan Gruber & James M. Poterba, 1993. "Tax Incentives and the Decision to Purchase Health Insurance: Evidence from the Self-Employed," NBER Working Papers 4435, National Bureau of Economic Research, Inc.
    15. James G. MacKinnon & Matthew D. Webb, 2017. "Pitfalls when Estimating Treatment Effects Using Clustered Data," Working Papers 1387, Queen's University, Department of Economics.
    16. David Roodman & Jonathan Morduch, 2014. "The Impact of Microcredit on the Poor in Bangladesh: Revisiting the Evidence," Journal of Development Studies, Taylor & Francis Journals, vol. 50(4), pages 583-604, April.
    17. James G. MacKinnon & Morten Ørregaard Nielsen & Matthew D. Webb, 2017. "Bootstrap and Asymptotic Inference with Multiway Clustering," Working Papers 1386, Queen's University, Department of Economics.
    18. Marianne Bertrand & Esther Duflo & Sendhil Mullainathan, 2004. "How Much Should We Trust Differences-In-Differences Estimates?," The Quarterly Journal of Economics, Oxford University Press, vol. 119(1), pages 249-275.
    19. repec:ags:stataj:180074 is not listed on IDEAS
    20. Mark M. Pitt & Shahidur R. Khandker, 1998. "The Impact of Group-Based Credit Programs on Poor Households in Bangladesh: Does the Gender of Participants Matter?," Journal of Political Economy, University of Chicago Press, vol. 106(5), pages 958-996, October.
    21. James G. MacKinnon & Matthew D. Webb, 2017. "Pitfalls when Estimating Treatment Effects Using Clustered Data," Working Papers 1387, Queen's University, Department of Economics.
    22. David Roodman, 2011. "Fitting fully observed recursive mixed-process models with cmp," Stata Journal, StataCorp LP, vol. 11(2), pages 159-206, June.
    23. White, Halbert, 1980. "A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for Heteroskedasticity," Econometrica, Econometric Society, vol. 48(4), pages 817-838, May.
    24. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    25. Davidson, James & Monticini, Andrea & Peel, David, 2007. "Implementing the wild bootstrap using a two-point distribution," Economics Letters, Elsevier, vol. 96(3), pages 309-315, September.
    26. Matthew D. Webb, 2014. "Reworking Wild Bootstrap Based Inference for Clustered Errors," Working Papers 1315, Queen's University, Department of Economics.
    27. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    28. Keith Finlay & Leandro M. Magnusson, 2014. "Bootstrap Methods for Inference with Cluster-Sample IV Models," Economics Discussion / Working Papers 14-12, The University of Western Australia, Department of Economics.
    29. Bester, C. Alan & Conley, Timothy G. & Hansen, Christian B., 2011. "Inference with dependent data using cluster covariance estimators," Journal of Econometrics, Elsevier, vol. 165(2), pages 137-151.
    30. William Gould, 2010. "Mata Matters: Stata in Mata," Stata Journal, StataCorp LP, vol. 10(1), pages 125-142, March.
    31. Jonathan Gruber & James Poterba, 1994. "Tax Incentives and the Decision to Purchase Health Insurance: Evidence from the Self-Employed," The Quarterly Journal of Economics, Oxford University Press, vol. 109(3), pages 701-733.
    32. C. A. Field & A. H. Welsh, 2007. "Bootstrapping clustered data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(3), pages 369-390.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Jacqueline Doremus, 2018. "Unintended Impacts from Forest Certification: Evidence from Indigenous Aka Households in Congo," Working Papers 1804, California Polytechnic State University, Department of Economics.

    More about this item

    Keywords

    Anderson-Rubin test; Wald test; wild bootstrap; wild cluster bootstrap; score bootstrap; multi-way clustering; few treated clusters; boottest; waldtest; artest;

    JEL classification:

    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General
    • C21 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Cross-Sectional Models; Spatial Models; Treatment Effect Models
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C25 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Discrete Regression and Qualitative Choice Models; Discrete Regressors; Proportions; Probabilities
    • C36 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Instrumental Variables (IV) Estimation

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1406. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Mark Babcock). General contact details of provider: http://edirc.repec.org/data/qedquca.html .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.