This file is part of IDEAS, which uses RePEc data


[ Papers | Articles | Software | Books | Chapters | Authors | Institutions | JEL Classification | NEP reports | Search | New papers by email | Author registration | Rankings | Volunteers | FAQ | Blog | Help! ]

p-Value Adjustments for Asymptotic Control of the Generalized Familywise Error Rate

Author info | Abstract | Publisher info | Download info | Related research | Statistics
Author Info
Christopher J. Bennett () (Department of Economics, Vanderbilt University)

Additional information is available for the following registered author(s):

Abstract

This paper introduces a computationally efficient bootstrap procedure for obtaining multiplicity-adjusted p-values in situations where multiple hypotheses are tested simultaneously. This new testing procedure accounts for the mutual dependence of the individual statistics, and is shown under weak conditions to maintain asymptotic control of the generalized familywise error rate. Moreover, the estimated critical values (p-values) obtained via our procedure are less sensitive to the inclusion of true hypotheses and, as a result, our test has greater power to identify false hypotheses even as the collection of hypotheses under test increases in size. Another attractive feature of our test is that it leads naturally to balance among the individual hypotheses under test. This feature is especially attractive in settings where balance is desired but alternative approaches, such as those based on studentization, are difficult or infeasible.

Download Info
To download:

If you experience problems downloading a file, check if you have the proper application to view it first. Information about this may be contained in the File-Format links below. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.

File URL: http://www.vanderbilt.edu/Econ/wparchive/workpaper/vu09-w05.pdf
File Format: application/pdf
File Function: First version, 2009
Download Restriction: no

Publisher Info
Paper provided by Department of Economics, Vanderbilt University in its series Working Papers with number 0905.

Download reference. The following formats are available: HTML (with abstract), plain text (with abstract), BibTeX, RIS (EndNote, RefMan, ProCite), ReDIF
Length:
Date of creation: Apr 2009
Date of revision:
Handle: RePEc:van:wpaper:0905

Contact details of provider:
Postal: Box 1819, Station B, Nashville, TN 37235
Fax: 615-343-8495
Email:
Web page: http://sitemason.vanderbilt.edu/econ/
More information through EDIRC

For technical questions regarding this item, or to correct its listing, contact: (Diana Weymark).

Related research
Keywords: Bootstrap; familywise error; multiple testing; step-down; balanced testing;

Find related papers by JEL classification:
C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Hypothesis Testing
C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: General - - - Semiparametric and Nonparametric Methods
C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation and Testing

This paper has been announced in the following NEP Reports:

References listed on IDEAS
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
  1. Joseph P. Romano & Michael Wolf, 2008. "Balanced Control of Generalized Error Rates," IEW - Working Papers iewwp379, Institute for Empirical Research in Economics - IEW. [Downloadable!]
  2. Leslie G. Godfrey, 2005. "Controlling the Overall Significance Level of a Battery of Least Squares Diagnostic Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 67(2), pages 263-279, 04. [Downloadable!] (restricted)
  3. Romano, Joseph P. & Shaikh, Azeem M. & Wolf, Michael, 2008. "Formalized Data Snooping Based On Generalized Error Rates," Econometric Theory, Cambridge University Press, vol. 24(02), pages 404-447, April. [Downloadable!]
    Other versions:
  4. Donald W. K. Andrews, 2000. "Inconsistency of the Bootstrap when a Parameter Is on the Boundary of the Parameter Space," Econometrica, Econometric Society, vol. 68(2), pages 399-406, March.
  5. Joseph P. Romano & Michael Wolf, 2005. "Stepwise Multiple Testing as Formalized Data Snooping," Econometrica, Econometric Society, vol. 73(4), pages 1237-1282, 07. [Downloadable!] (restricted)
  6. Sandrine Dudoit & Mark van der Laan & Katherine Pollard, 2004. "Multiple Testing. Part I. Single-Step Procedures for Control of General Type I Error Rates," U.C. Berkeley Division of Biostatistics Working Paper Series 1137, Berkeley Electronic Press. [Downloadable!]
  7. Joe, Harry, 2006. "Generating random correlation matrices based on partial correlations," Journal of Multivariate Analysis, Elsevier, vol. 97(10), pages 2177-2189, November. [Downloadable!] (restricted)
  8. Joseph P. Romano & Michael Wolf, 2005. "Exact and Approximate Stepdown Methods for Multiple Hypothesis Testing," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 94-108, March. [Downloadable!] (restricted)
Full references

Statistics
Access and download statistics

Did you know? There are NEP reports in over 80 fields that deliver new research to your email.

This page was last updated on 2009-11-14.


This information is provided to you by IDEAS at the Department of Economics, College of Liberal Arts and Sciences, University of Connecticut using RePEc data on a server sponsored by the Society for Economic Dynamics.