IDEAS home Printed from https://ideas.repec.org/p/qed/wpaper/1036.html
   My bibliography  Save this paper

Bootstrap Tests: How Many Bootstraps?

Author

Listed:
  • James G. MacKinnon

    (Queen's University)

  • Russell Davidson

    (McGill University)

Abstract

In practice, bootstrap tests must use a finite number of bootstrap samples. This means that the outcome of the test will depend on the sequence of random numbers used to generate the bootstrap samples, and it necessarily results in some loss of power. We examine the extent of this power loss and propose a simple pretest procedure for choosing the number of bootstrap samples so as to minimize experimental randomness. Simulation experiments suggest that this procedure will work very well in practice.

Suggested Citation

  • James G. MacKinnon & Russell Davidson, 2001. "Bootstrap Tests: How Many Bootstraps?," Working Paper 1036, Economics Department, Queen's University.
    • Handle: RePEc:qed:wpaper:1036
    as

    Download full text from publisher

    File URL: https://www.econ.queensu.ca/sites/econ.queensu.ca/files/qed_wp_1036.pdf
    File Function: First version 2001
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. F. H. C. Marriott, 1979. "Barnard's Monte Carlo Tests: How Many Simulations?," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 28(1), pages 75-77, March.
    2. Davidson, Russell & MacKinnon, James G, 1998. "Graphical Methods for Investigating the Size and Power of Hypothesis Tests," The Manchester School of Economic & Social Studies, University of Manchester, vol. 66(1), pages 1-26, January.
    3. Horowitz, Joel L., 1994. "Bootstrap-based critical values for the information matrix test," Journal of Econometrics, Elsevier, vol. 61(2), pages 395-411, April.
    4. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(3), pages 361-376, June.
    5. Donald W. K. Andrews & Moshe Buchinsky, 2000. "A Three-Step Method for Choosing the Number of Bootstrap Repetitions," Econometrica, Econometric Society, vol. 68(1), pages 23-52, January.
    6. Jean-Marie Dufour & Jan F. Kiviet, 1998. "Exact Inference Methods for First-Order Autoregressive Distributed Lag Models," Econometrica, Econometric Society, vol. 66(1), pages 79-104, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davidson, Russell & MacKinnon, James G., 1996. "The Power of Bootstrap Tests," Queen's Institute for Economic Research Discussion Papers 273372, Queen's University - Department of Economics.
    2. Emmanuel Flachaire, 2000. "Les méthodes du bootstrap dans les modèles de régression," Économie et Prévision, Programme National Persée, vol. 142(1), pages 183-194.
    3. Davidson, Russell & MacKinnon, James G., 2002. "Bootstrap J tests of nonnested linear regression models," Journal of Econometrics, Elsevier, vol. 109(1), pages 167-193, July.
    4. Chiu, Sung Nok & Wang, Ling, 2009. "Homogeneity tests for several Poisson populations," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 4266-4278, October.
    5. Wesseh, Presley K. & Zoumara, Babette, 2012. "Causal independence between energy consumption and economic growth in Liberia: Evidence from a non-parametric bootstrapped causality test," Energy Policy, Elsevier, vol. 50(C), pages 518-527.
    6. Davidson, Russell & MacKinnon, James G., 2006. "The power of bootstrap and asymptotic tests," Journal of Econometrics, Elsevier, vol. 133(2), pages 421-441, August.
    7. de Peretti, Christian & Siani, Carole, 2010. "Graphical methods for investigating the finite-sample properties of confidence regions," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 262-271, February.
    8. Davidson, Russell & MacKinnon, James G., 1997. "Bootstrap Testing How Many Bootstraps," Queen's Institute for Economic Research Discussion Papers 273385, Queen's University - Department of Economics.
    9. Riccardo Lucchetti & Claudia Pigini, 2013. "A test for bivariate normality with applications in microeconometric models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 22(4), pages 535-572, November.
    10. Lin, Boqiang & Wesseh Jr., Presley K., 2014. "Energy consumption and economic growth in South Africa reexamined: A nonparametric testing apporach," Renewable and Sustainable Energy Reviews, Elsevier, vol. 40(C), pages 840-850.
    11. Christian de Peretti, 2003. "Bilateral Bootstrap Tests for Long Memory: An Application to the Silver Market," Computational Economics, Springer;Society for Computational Economics, vol. 22(2), pages 187-212, October.
    12. Jamel Jouini, 2006. "Bootstrap Tests in Bivariate VAR Process with Single Structural Change : Power versus Corrected Size and Empirical Illustration," Working Papers halshs-00410759, HAL.
    13. Mantalos Panagiotis, 2003. "Bootstrapping the Breusch-Godfrey autocorrelation test for a single equation dynamic model: Bootstrapping the Restricted vs. Unrestricted model," Monte Carlo Methods and Applications, De Gruyter, vol. 9(3), pages 257-269, September.
    14. James G. MacKinnon & Russell Davidson, 2000. "Improving The Reliability Of Bootstrap Tests," Working Paper 995, Economics Department, Queen's University.
    15. Davidson, Russell & Flachaire, Emmanuel, 2007. "Asymptotic and bootstrap inference for inequality and poverty measures," Journal of Econometrics, Elsevier, vol. 141(1), pages 141-166, November.
    16. Nyakabawo, Wendy & Miller, Stephen M. & Balcilar, Mehmet & Das, Sonali & Gupta, Rangan, 2015. "Temporal causality between house prices and output in the US: A bootstrap rolling-window approach," The North American Journal of Economics and Finance, Elsevier, vol. 33(C), pages 55-73.
    17. Dufour, Jean-Marie, 2006. "Monte Carlo tests with nuisance parameters: A general approach to finite-sample inference and nonstandard asymptotics," Journal of Econometrics, Elsevier, vol. 133(2), pages 443-477, August.
    18. Christian Peretti, 2007. "Long Memory and Hysteresis," Springer Books, in: Gilles Teyssière & Alan P. Kirman (ed.), Long Memory in Economics, pages 363-389, Springer.
    19. Davidson, Russell & Flachaire, Emmanuel, 2008. "The wild bootstrap, tamed at last," Journal of Econometrics, Elsevier, vol. 146(1), pages 162-169, September.
    20. Wanling Huang & Artem Prokhorov, 2014. "A Goodness-of-fit Test for Copulas," Econometric Reviews, Taylor & Francis Journals, vol. 33(7), pages 751-771, October.

    More about this item

    Keywords

    bootstrap test; test power; pretest; bootstrap repetitions; bootstrap samples;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Statistical Simulation Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:qed:wpaper:1036. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Mark Babcock (email available below). General contact details of provider: https://edirc.repec.org/data/qedquca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.