Estimation of the proportion of true null hypotheses in high-dimensional data under dependence
AbstractIn multiple testing, a challenging issue is to provide an accurate estimation of the proportion [pi]0 of true null hypotheses among the whole set of tests. Besides a biological interpretation, this parameter is involved in the control of error rates such as the False Discovery Rate. Improving its estimation can result in more powerful/less conservative methods of differential analysis. Various methods for [pi]0 estimation have been previously developed. Most of them rely on the assumption of independent p-values distributed according to a two-component mixture model, with a uniform distribution for null p-values. In a general factor analytic framework, the impact of dependence on the properties of the estimation procedures is first investigated and exact expressions of bias and variance are provided in case of dependent data. A more accurate factor-adjusted estimator of [pi]0 is finally presented, which shows large improvements with respect to the standard procedures.
Download InfoIf you experience problems downloading a file, check if you have the proper application to view it first. In case of further problems read the IDEAS help page. Note that these files are not on the IDEAS site. Please be patient as the files may be large.
As the access to this document is restricted, you may want to look for a different version under "Related research" (further below) or search for a different version of it.
Bibliographic InfoArticle provided by Elsevier in its journal Computational Statistics & Data Analysis.
Volume (Year): 55 (2011)
Issue (Month): 9 (September)
Contact details of provider:
Web page: http://www.elsevier.com/locate/csda
Dependence High dimension Multiple-hypothesis testing Proportion of true null hypotheses;
Please report citation or reference errors to , or , if you are the registered author of the cited work, log in to your RePEc Author Service profile, click on "citations" and make appropriate adjustments.:
- Robin, Stephane & Bar-Hen, Avner & Daudin, Jean-Jacques & Pierre, Laurent, 2007. "A semi-parametric approach for mixture models: Application to local false discovery rate estimation," Computational Statistics & Data Analysis, Elsevier, vol. 51(12), pages 5483-5493, August.
- Nguyen, Danh V., 2004. "On estimating the proportion of true null hypotheses for false discovery rate controlling procedures in exploratory DNA microarray studies," Computational Statistics & Data Analysis, Elsevier, vol. 47(3), pages 611-637, October.
- Efron, Bradley, 2007. "Correlation and Large-Scale Simultaneous Significance Testing," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 93-103, March.
- Mette Langaas & Bo Henry Lindqvist & Egil Ferkingstad, 2005. "Estimating the proportion of true null hypotheses, with application to DNA microarray data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(4), pages 555-572.
- John D. Storey, 2002. "A direct approach to false discovery rates," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 479-498.
- Friguet, ChloÃ© & Kloareg, Maela & Causeur, David, 2009. "A Factor Model Approach to Multiple Testing Under Dependence," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1406-1415.
- Donald Rubin & Dorothy Thayer, 1982. "EM algorithms for ML factor analysis," Psychometrika, Springer, vol. 47(1), pages 69-76, March.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Wendy Shamier).
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If references are entirely missing, you can add them using this form.
If the full references list an item that is present in RePEc, but the system did not link to it, you can help with this form.
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your profile, as there may be some citations waiting for confirmation.
Please note that corrections may take a couple of weeks to filter through the various RePEc services.