IDEAS home Printed from https://ideas.repec.org/p/mol/ecsdps/esdp11059.html

FDR Control in the Presence of an Unknown Correlation Structure

Author

Listed:
  • Cerqueti, Roy
  • Costantini, Mauro
  • Lupi, Claudio

Abstract

The false discovery rate (FDR, Benjamini and Hochberg 1995) is a powerful approach to multiple testing. However, the original approach developed by Benjamini and Hochberg (1995) applies only to independent tests. Yekutieli (2008) showed that a modification of the Benjamini-Hochberg (BH) approach can be used in the presence of dependent tests and labelled his procedure as separate subsets BH (ssBH). However, Yekutieli (2008) left the practical specification of the subsets of p values largely unresolved. In this paper we propose a modification of the ssBH procedure based on a selection of the subsets that guarantees that the dependence properties needed to control the FDR are satisfied. We label this new procedure as the separate pairs BH (spBH). An extensive Monte Carlo analysis is presented that compares the properties of the BH and spBH procedures.

Suggested Citation

  • Cerqueti, Roy & Costantini, Mauro & Lupi, Claudio, 2011. "FDR Control in the Presence of an Unknown Correlation Structure," Economics & Statistics Discussion Papers esdp11059, University of Molise, Department of Economics.
    • Handle: RePEc:mol:ecsdps:esdp11059
    as

    Download full text from publisher

    File URL: http://web.unimol.it/progetti/repec/mol/ecsdps/ESDP11059.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cribari-Neto, Francisco, 2004. "Asymptotic inference under heteroskedasticity of unknown form," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 215-233, March.
    2. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    3. John D. Storey & Jonathan E. Taylor & David Siegmund, 2004. "Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(1), pages 187-205, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Cerqueti, Roy & Lupi, Claudio, 2015. "Total positivity for a class of non-exchangeable copulas," Economics & Statistics Discussion Papers esdp15077, University of Molise, Department of Economics.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Annalivia Polselli, 2023. "Robust Inference in Panel Data Models: Some Effects of Heteroskedasticity and Leveraged Data in Small Samples," Papers 2312.17676, arXiv.org.
    2. Benoît Le Maux & Federica Minardy & Charlotte Magalhaes, 2011. "Determinants of Electoral Outcomes: A simple Test of Meltzer and Richard's Hypothesis," Economics Working Paper from Condorcet Center for political Economy at CREM-CNRS 2011-03-ccr, Condorcet Center for political Economy.
    3. Guillaume Marrelec & Alain Giron, 2024. "Inferring the finest pattern of mutual independence from data," Statistical Papers, Springer, vol. 65(3), pages 1677-1702, May.
    4. Richard H. Clarida & Mark P. Taylor, 2003. "Nonlinear Permanent - Temporary Decompositions in Macroeconomics and Finance," Economic Journal, Royal Economic Society, vol. 113(486), pages 125-139, March.
    5. Bajgrowicz, Pierre & Scaillet, Olivier, 2012. "Technical trading revisited: False discoveries, persistence tests, and transaction costs," Journal of Financial Economics, Elsevier, vol. 106(3), pages 473-491.
    6. repec:ags:aaea22:335733 is not listed on IDEAS
    7. Neil R. Ericsson & James G. MacKinnon, 2002. "Distributions of error correction tests for cointegration," Econometrics Journal, Royal Economic Society, vol. 5(2), pages 285-318, June.
    8. Jianqing Fan & Xu Han, 2017. "Estimation of the false discovery proportion with unknown dependence," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(4), pages 1143-1164, September.
    9. Shigeyuki Matsui & Hisashi Noma, 2011. "Estimating Effect Sizes of Differentially Expressed Genes for Power and Sample-Size Assessments in Microarray Experiments," Biometrics, The International Biometric Society, vol. 67(4), pages 1225-1235, December.
    10. Lianming Wang & David B. Dunson, 2010. "Semiparametric Bayes Multiple Testing: Applications to Tumor Data," Biometrics, The International Biometric Society, vol. 66(2), pages 493-501, June.
    11. Szafranek, Karol, 2017. "Flattening of the New Keynesian Phillips curve: Evidence for an emerging, small open economy," Economic Modelling, Elsevier, vol. 63(C), pages 334-348.
    12. Katarzyna Jabłońska, 2018. "Dealing With Heteroskedasticity Within The Modeling Of The Quality Of Life Of Older People," Statistics in Transition New Series, Polish Statistical Association, vol. 19(3), pages 423-452, September.
    13. Hanck, Christoph, 2011. "Now, whose schools are really better (or weaker) than Germany's? A multiple testing approach," Economic Modelling, Elsevier, vol. 28(4), pages 1739-1746, July.
    14. Hamilton, James D., 1996. "Specification testing in Markov-switching time-series models," Journal of Econometrics, Elsevier, vol. 70(1), pages 127-157, January.
    15. Ghosh Debashis, 2012. "Incorporating the Empirical Null Hypothesis into the Benjamini-Hochberg Procedure," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(4), pages 1-21, July.
    16. Campos, Julia & Ericsson, Neil R. & Hendry, David F., 1996. "Cointegration tests in the presence of structural breaks," Journal of Econometrics, Elsevier, vol. 70(1), pages 187-220, January.
    17. VAN DIJK, Herman K., 1987. "Some advances in Bayesian estimations methods using Monte Carlo Integration," LIDAM Reprints CORE 783, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    18. Mauro Costantini & Claudio Lupi, 2013. "A Simple Panel-CADF Test for Unit Roots," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(2), pages 276-296, April.
    19. Dean Palejev & Mladen Savov, 2021. "On the Convergence of the Benjamini–Hochberg Procedure," Mathematics, MDPI, vol. 9(17), pages 1-19, September.
    20. Cheng, Tsung-Chi, 2012. "On simultaneously identifying outliers and heteroscedasticity without specific form," Computational Statistics & Data Analysis, Elsevier, vol. 56(7), pages 2258-2272.
    21. Moon, H.R. & Perron, B., 2012. "Beyond panel unit root tests: Using multiple testing to determine the nonstationarity properties of individual series in a panel," Journal of Econometrics, Elsevier, vol. 169(1), pages 29-33.

    More about this item

    Keywords

    ;
    ;
    ;

    JEL classification:

    • C10 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - General
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:mol:ecsdps:esdp11059. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Claudio Lupi (email available below). General contact details of provider: https://edirc.repec.org/data/dsmolit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.