IDEAS home Printed from https://ideas.repec.org/p/qed/wpaper/1036.html

Bootstrap Tests: How Many Bootstraps?

Author

Listed:
  • James G. MacKinnon

    (Queen's University)

  • Russell Davidson

    (McGill University)

Abstract

In practice, bootstrap tests must use a finite number of bootstrap samples. This means that the outcome of the test will depend on the sequence of random numbers used to generate the bootstrap samples, and it necessarily results in some loss of power. We examine the extent of this power loss and propose a simple pretest procedure for choosing the number of bootstrap samples so as to minimize experimental randomness. Simulation experiments suggest that this procedure will work very well in practice.

Suggested Citation

  • James G. MacKinnon & Russell Davidson, 2001. "Bootstrap Tests: How Many Bootstraps?," Working Paper 1036, Economics Department, Queen's University.
    • Handle: RePEc:qed:wpaper:1036
    as

    Download full text from publisher

    File URL: https://www.econ.queensu.ca/sites/econ.queensu.ca/files/qed_wp_1036.pdf
    File Function: First version 2001
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Horowitz, Joel L., 1994. "Bootstrap-based critical values for the information matrix test," Journal of Econometrics, Elsevier, vol. 61(2), pages 395-411, April.
    2. Horowitz, J., 1996. "Bootstrap Critical Values For Tests Based On The Smoothed Maximum Score Estimator," SFB 373 Discussion Papers 1996,44, Humboldt University of Berlin, Interdisciplinary Research Project 373: Quantification and Simulation of Economic Processes.
    3. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    4. Joel L. Horowitz, 1996. "Bootstrap Critical Values for Tests Based on the Smoothed Maximum Score Estimator," Econometrics 9603003, University Library of Munich, Germany.
    5. F. H. C. Marriott, 1979. "Barnard's Monte Carlo Tests: How Many Simulations?," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 28(1), pages 75-77, March.
    6. Donald W. K. Andrews & Moshe Buchinsky, 2000. "A Three-Step Method for Choosing the Number of Bootstrap Repetitions," Econometrica, Econometric Society, vol. 68(1), pages 23-52, January.
    7. Hall, Peter & Horowitz, Joel L, 1996. "Bootstrap Critical Values for Tests Based on Generalized-Method-of-Moments Estimators," Econometrica, Econometric Society, vol. 64(4), pages 891-916, July.
    8. Jean-Marie Dufour & Jan F. Kiviet, 1998. "Exact Inference Methods for First-Order Autoregressive Distributed Lag Models," Econometrica, Econometric Society, vol. 66(1), pages 79-104, January.
    9. Davidson, Russell & MacKinnon, James G, 1998. "Graphical Methods for Investigating the Size and Power of Hypothesis Tests," The Manchester School of Economic & Social Studies, University of Manchester, vol. 66(1), pages 1-26, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davidson, Russell & MacKinnon, James G., 1996. "The Power of Bootstrap Tests," Queen's Institute for Economic Research Discussion Papers 273372, Queen's University - Department of Economics.
    2. Davidson, Russell & MacKinnon, James G., 1997. "Bootstrap Testing How Many Bootstraps," Queen's Institute for Economic Research Discussion Papers 273385, Queen's University - Department of Economics.
    3. Joel L. Horowitz, 2018. "Bootstrap Methods in Econometrics," Papers 1809.04016, arXiv.org.
    4. Yang, Zhenlin, 2015. "LM tests of spatial dependence based on bootstrap critical values," Journal of Econometrics, Elsevier, vol. 185(1), pages 33-59.
    5. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    6. Yazid Dissou & Reza Ghazal, 2010. "Energy Substitutability in Canadian Manufacturing Econometric Estimation with Bootstrap Confidence Intervals," The Energy Journal, , vol. 31(1), pages 121-148, January.
    7. Wolfgang Härdle & Joel Horowitz & Jens‐Peter Kreiss, 2003. "Bootstrap Methods for Time Series," International Statistical Review, International Statistical Institute, vol. 71(2), pages 435-459, August.
    8. Gregory, Allan W. & Lamarche, Jean-Francois & Smith, Gregor W., 2002. "Information-theoretic estimation of preference parameters: macroeconomic applications and simulation evidence," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 213-233, March.
    9. Zhenlin Yang, 2018. "Bootstrap LM tests for higher-order spatial effects in spatial linear regression models," Empirical Economics, Springer, vol. 55(1), pages 35-68, August.
    10. Bergström, Pål, 1999. "Bootstrap Methods and Applications in Econometrics - A Brief Survey," Working Paper Series 1999:2, Uppsala University, Department of Economics.
    11. Ilaria Piatti & Fabio Trojani, 2020. "Dividend Growth Predictability and the Price–Dividend Ratio," Management Science, INFORMS, vol. 66(1), pages 130-158, January.
    12. Li, Jing, 2006. "The block bootstrap test of Hausman's exogeneity in the presence of serial correlation," Economics Letters, Elsevier, vol. 91(1), pages 76-82, April.
    13. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    14. Jeremy Berkowitz & Lutz Kilian, 2000. "Recent developments in bootstrapping time series," Econometric Reviews, Taylor & Francis Journals, vol. 19(1), pages 1-48.
    15. Groneck, Max & Ludwig, Alexander & Zimper, Alexander, 2016. "A life-cycle model with ambiguous survival beliefs," Journal of Economic Theory, Elsevier, vol. 162(C), pages 137-180.
    16. Kundhi, Gubhinder & Rilstone, Paul, 2012. "Edgeworth expansions for GEL estimators," Journal of Multivariate Analysis, Elsevier, vol. 106(C), pages 118-146.
    17. Davidson, Russell & MacKinnon, James G., 2002. "Bootstrap J tests of nonnested linear regression models," Journal of Econometrics, Elsevier, vol. 109(1), pages 167-193, July.
    18. Choi, Jaedo & Moon, Hyungsik Roger & Cho, Jin Seo, 2024. "Sequentially Estimating The Structural Equation By Power Transformation," Econometric Theory, Cambridge University Press, vol. 40(1), pages 98-161, February.
    19. Jinyong Hahn & Zhipeng Liao, 2021. "Bootstrap Standard Error Estimates and Inference," Econometrica, Econometric Society, vol. 89(4), pages 1963-1977, July.
    20. Seojeong Lee, 2018. "A Consistent Variance Estimator for 2SLS When Instruments Identify Different LATEs," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 36(3), pages 400-410, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1036. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Babcock (email available below). General contact details of provider: https://edirc.repec.org/data/qedquca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.