This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

Bootstrap Tests: How Many Bootstraps?

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Russell Davidson
James G. MacKinnon

Additional information is available for the following registered author(s):

Abstract

This paper discusses how to choose the number of bootstrap samples when performing bootstrap tests. There are two important issues that arise when the number of bootstraps is finite. One is bias in the estimation of bootstrap $P$ values or critical values, and the second is loss of power. We discuss an easy way to avoid bias and thus obtain exact tests if the underlying test statistic is pivotal. We also propose a simple pretest procedure for choosing the number of bootstrap samples so as to avoid power loss, and we illustrate its performance using sampling experiments.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help file. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.econ.queensu.ca/working_papers/papers/qed_wp_951.pdf
File Format: application/pdf
File Function: First version 1997
Download Restriction: no

Publisher Info
Paper provided by Queen's University, Department of Economics in its series Working Papers with number 951.

Download reference. The following formats are available: HTML, plain text, BibTeX, RIS (EndNote), ReDIF
Length:
Date of creation: Sep 1997
Date of revision:
Publication status: Published in Econometric Reviews, 19, 2000
Handle: RePEc:qed:wpaper:951

Contact details of provider:
Postal: Kingston, Ontario, K7L 3N6
Phone: (613) 533-2250
Fax: (613) 533-6668
Email:
Web page: http://www.econ.queensu.ca/
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Mark Babcock).

Related research
Keywords: Bootstrap testing Bootstrap samples

Other versions of this item:

Find related papers by JEL classification:
C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Hypothesis Testing
C15 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Statistical Simulation Methods

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:

  1. Davidson, Russell & MacKinnon, James G, 1998. "Graphical Methods for Investigating the Size and Power of Hypothesis Tests," The Manchester School of Economic & Social Studies, Blackwell Publishing, vol. 66(1), pages 1-26, January.
    Other versions:
  2. G. S. Hongyi Li, 1996. "Bootstrapping time series models," Econometric Reviews, Taylor and Francis Journals, vol. 15(2), pages 115-158. [Downloadable!] (restricted)
  3. Donald W. K. Andrews & Moshe Buchinsky, 2000. "A Three-Step Method for Choosing the Number of Bootstrap Repetitions," Econometrica, Econometric Society, vol. 68(1), pages 23-52, January.
  4. Davidson, Russell & MacKinnon, James G., 1999. "The Size Distortion Of Bootstrap Tests," Econometric Theory, Cambridge University Press, vol. 15(03), pages 361-376, June. [Downloadable!]
    Other versions:
  5. Jean-Marie Dufour & Jan F. Kiviet, 1998. "Exact Inference Methods for First-Order Autoregressive Distributed Lag Models," Econometrica, Econometric Society, vol. 66(1), pages 79-104, January.
    Other versions:
  6. Horowitz, Joel L., 1994. "Bootstrap-based critical values for the information matrix test," Journal of Econometrics, Elsevier, vol. 61(2), pages 395-411, April. [Downloadable!] (restricted)
Full references

Cited by:
(explanations, Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.)

  1. Judith A. Clarke & Marsha J. Courchane & Nilanjana Roy, 2005. "On the Robustness of Racial Discrimination Findings in Mortgage Lending Studies," Econometrics Working Papers 0516, Department of Economics, University of Victoria. [Downloadable!]
  2. Dercon, Stefan & Hoddinott, John & Krishnan, Pramila & Woldehannnam, Tassew, 2008. "Collective action and vulnerability: Burial societies in rural Ethiopia," CAPRi Working Papers 83, International Food Policy Research Institute (IFPRI). [Downloadable!]
  3. Valentina Corradi & Norman R. Swanson, 2003. "Bootstrap Conditional Distribution Tests In the Presence of Dynamic Misspecification," Departmental Working Papers 200311, Rutgers University, Department of Economics. [Downloadable!]
    Other versions:
  4. Carsten Trenkler, 2006. "Bootstrapping Systems Cointegration Tests with a Prior Adjustment for Deterministic Terms," SFB 649 Discussion Papers SFB649DP2006-012, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany. [Downloadable!]
  5. Brian P. Poi, 2004. "From the help desk: Some bootstrapping techniques," Stata Journal, StataCorp LP, vol. 4(3), pages 312-328, September. [Downloadable!]
  6. James G. MacKinnon, 2006. "Bootstrap Methods in Econometrics," Working Papers 1028, Queen's University, Department of Economics. [Downloadable!]
    Other versions:
  7. Jeff Racine & James G. MacKinnon, 2004. "Simulation-based Tests that Can Use Any Number of Simulations," Working Papers 1027, Queen's University, Department of Economics. [Downloadable!]
  8. Nilanjana Roy, 2002. "Is Adaptive Estimation Useful For Panel Models With Heteroskedasticity In The Individual Specific Error Component? Some Monte Carlo Evidence," Econometric Reviews, Taylor and Francis Journals, vol. 21(2), pages 189-203. [Downloadable!] (restricted)
  9. Strikholm, Birgit & Teräsvirta, Timo, 2005. "Determining the Number of Regimes in a Threshold Autoregressive Model Using Smooth Transition Autoregressions," Working Paper Series in Economics and Finance 578, Stockholm School of Economics, revised 11 Feb 2005. [Downloadable!]
  10. José M. Labeaga & Xisco Oliver & Amedeo Spadaro, . "Measuring Changes in Health Capital," Working Papers 2005-15, FEDEA. [Downloadable!]
  11. Russell Davidson & James MacKinnon, 2002. "Fast Double Bootstrap Tests Of Nonnested Linear Regression Models," Econometric Reviews, Taylor and Francis Journals, vol. 21(4), pages 419-429. [Downloadable!] (restricted)
  12. Christian de Peretti & Carole Siani, 2004. "Neural Tests for Conditional Heteroskedasticity in ARCH-M Models," Studies in Nonlinear Dynamics & Econometrics, Berkeley Electronic Press, vol. 8(3), pages 1239-1239. [Downloadable!] (restricted)
  13. Denis Bolduc & Lynda Khalaf & Clément Yélou, 2005. "Identification Robust Confidence Sets Methods for Inference on Parameter Ratios and their Application to Estimating Value-of-Time," Computing in Economics and Finance 2005 48, Society for Computational Economics. [Downloadable!]
  14. Judith A. Clarke & Nilanjana Roy & Marsha J. Courchane, 2006. "On the Robustness of Racial Disrcimination Findings in Motgage Lending Studies," Econometrics Working Papers 0604, Department of Economics, University of Victoria. [Downloadable!]
  15. Russell Davidson & James G. MacKinnon, 2004. "The Power of Bootstrap and Asymptotic Tests," Working Papers 1035, Queen's University, Department of Economics. [Downloadable!]
    Other versions:
  16. James G. MacKinnon, 2007. "Bootstrap Hypothesis Testing," Working Papers 1127, Queen's University, Department of Economics. [Downloadable!]
  17. Donald W.K. Andrews & Moshe Buchinsky, 1997. "On the Number of Bootstrap Repetitions for Bootstrap Standard Errors, Confidence Intervals, and Tests," Cowles Foundation Discussion Papers 1141R, Cowles Foundation, Yale University. [Downloadable!]
  18. Jean-Marie Dufour & Lynda Khalaf, 2000. "Simulation Based Finite and Large Sample Tests in Multivariate Regressions," CIRANO Working Papers 2000s-15, CIRANO. [Downloadable!]
    Other versions:
  19. Ellingsen, Tore & Johannesson, Magnus, 2000. "Is There a Hold-up Problem?," Working Paper Series in Economics and Finance 357, Stockholm School of Economics. [Downloadable!]
    Other versions:
  20. Robert Taylor & Peter Burridge, 2004. "Bootstrapping the HEGY Seasonal Unit Root Tests," Econometric Society 2004 North American Summer Meetings 125, Econometric Society. [Downloadable!]
    Other versions:
Statistics
Access and download statistics

Did you know? You can create a compilation of all publications of a group of people, say alumni of a program, your students or memers of an association.

This page was last updated on 2008-11-13.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.