IDEAS home Printed from https://ideas.repec.org/p/hum/wpaper/sfb649dp2012-049.html
   My bibliography  Save this paper

Simultaneous test procedures in terms of p-value copulae

Author

Listed:
  • Thorsten Dickhaus
  • Jakob Gierl

Abstract

At least since [1], a broad class of multiple comparison procedures, so-called simultaneous test procedures (STPs), is established in the statistical literature. Elements of an STP are a testing family, consisting of a set of null hypotheses and corresponding test statistics, and a common critical constant. The latter threshold with which each of the test statistics has to be compared is calculated under the (joint) intersection hypothesis of all nulls. Under certain structural assumptions, the so-constructed STP provides strong control of the family-wise error rate. More recently, a general method to construct STPs in the case of asymptotic (joint) normality of the family of test statistics has been developed in [2], and numerical solutions to compute the critical constant in such cases were provided. Here, we propose to look at the problem from a different perspective. We will show that the threshold can equivalently be expressed by a quantile of the copula of the family of pvalues associated with the test statistics, assuming that each of these p-values is marginally uniformly distributed on the unit interval under the corresponding null hypothesis. This offers the opportunity to exploit the rich and growing literature on copula-based modeling of multivariate dependency structures for multiple testing problems and in particular for the construction of STPs in non-Gaussian situations.

Suggested Citation

  • Thorsten Dickhaus & Jakob Gierl, 2012. "Simultaneous test procedures in terms of p-value copulae," SFB 649 Discussion Papers SFB649DP2012-049, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
  • Handle: RePEc:hum:wpaper:sfb649dp2012-049
    as

    Download full text from publisher

    File URL: http://sfb649.wiwi.hu-berlin.de/papers/pdf/SFB649DP2012-049.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Cerqueti, Roy & Costantini, Mauro & Lupi, Claudio, 2012. "A copula-based analysis of false discovery rate control under dependence assumptions," Economics & Statistics Discussion Papers esdp12065, University of Molise, Department of Economics.
    2. Fengler, Matthias & Okhrin, Ostap, 2012. "Realized Copula," Economics Working Paper Series 1214, University of St. Gallen, School of Economics and Political Science.
    3. John D. Storey & Jonathan E. Taylor & David Siegmund, 2004. "Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(1), pages 187-205, February.
    4. Wolfgang Härdle & Ostap Okhrin, 2010. "De copulis non est disputandum," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 94(1), pages 1-31, March.
    5. Schäfer Juliane & Strimmer Korbinian, 2005. "A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 4(1), pages 1-32, November.
    6. Christian Genest & Michel Gendron & Michaël Bourdeau-Brien, 2009. "The Advent of Copulas in Finance," The European Journal of Finance, Taylor & Francis Journals, vol. 15(7-8), pages 609-618.
    7. Ghosal, Subhashis & Roy, Anindya, 2011. "Predicting False Discovery Proportion Under Dependence," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1208-1218.
    8. Wolfgang Härdle & Ostap Okhrin, 2009. "De copulis non est disputandum - Copulae: An Overview," SFB 649 Discussion Papers SFB649DP2009-031, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stange, Jens & Dickhaus, Thorsten & Navarro, Arcadi & Schunk, Daniel, 2016. "Multiplicity- and dependency-adjusted p-values for control of the family-wise error rate," Statistics & Probability Letters, Elsevier, vol. 111(C), pages 32-40.
    2. Elisa C. J. Maria & Isabel Salazar & Luis Sanz & Miguel A. Gómez-Villegas, 2020. "Using Copula to Model Dependence When Testing Multiple Hypotheses in DNA Microarray Experiments: A Bayesian Approximation," Mathematics, MDPI, vol. 8(9), pages 1-22, September.
    3. Steffen Nico & Dickhaus Thorsten, 2020. "Optimizing effective numbers of tests by vine copula modeling," Dependence Modeling, De Gruyter, vol. 8(1), pages 172-185, January.
    4. André Neumann & Thorsten Dickhaus, 2020. "Nonparametric Archimedean generator estimation with implications for multiple testing," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 104(2), pages 309-323, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jianqing Fan & Xu Han, 2017. "Estimation of the false discovery proportion with unknown dependence," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(4), pages 1143-1164, September.
    2. Hannart, Alexis & Naveau, Philippe, 2014. "Estimating high dimensional covariance matrices: A new look at the Gaussian conjugate framework," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 149-162.
    3. Avagyan, Vahe & Alonso Fernández, Andrés Modesto & Nogales, Francisco J., 2015. "D-trace Precision Matrix Estimation Using Adaptive Lasso Penalties," DES - Working Papers. Statistics and Econometrics. WS 21775, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. Bajgrowicz, Pierre & Scaillet, Olivier, 2012. "Technical trading revisited: False discoveries, persistence tests, and transaction costs," Journal of Financial Economics, Elsevier, vol. 106(3), pages 473-491.
    5. Fabrizio Durante & Roberto Ghiselli-Ricci, 2012. "Supermigrative copulas and positive dependence," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 96(3), pages 327-342, July.
    6. Oleg Sokolinskiy & Dick van Dijk, 2011. "Forecasting Volatility with Copula-Based Time Series Models," Tinbergen Institute Discussion Papers 11-125/4, Tinbergen Institute.
    7. Wang Xiaoming & Dinu Irina & Liu Wei & Yasui Yutaka, 2011. "Linear Combination Test for Hierarchical Gene Set Analysis," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 10(1), pages 1-18, March.
    8. Shigeyuki Matsui & Hisashi Noma, 2011. "Estimating Effect Sizes of Differentially Expressed Genes for Power and Sample-Size Assessments in Microarray Experiments," Biometrics, The International Biometric Society, vol. 67(4), pages 1225-1235, December.
    9. Lianming Wang & David B. Dunson, 2010. "Semiparametric Bayes Multiple Testing: Applications to Tumor Data," Biometrics, The International Biometric Society, vol. 66(2), pages 493-501, June.
    10. Elberg, Christina & Hagspiel, Simeon, 2015. "Spatial dependencies of wind power and interrelations with spot price dynamics," European Journal of Operational Research, Elsevier, vol. 241(1), pages 260-272.
    11. Seunghwan Lee & Sang Cheol Kim & Donghyeon Yu, 2023. "An efficient GPU-parallel coordinate descent algorithm for sparse precision matrix estimation via scaled lasso," Computational Statistics, Springer, vol. 38(1), pages 217-242, March.
    12. Hanck, Christoph, 2011. "Now, whose schools are really better (or weaker) than Germany's? A multiple testing approach," Economic Modelling, Elsevier, vol. 28(4), pages 1739-1746, July.
    13. Bala Rajaratnam & Dario Vincenzi, 2016. "A theoretical study of Stein's covariance estimator," Biometrika, Biometrika Trust, vol. 103(3), pages 653-666.
    14. Wang, Christina Dan & Chen, Zhao & Lian, Yimin & Chen, Min, 2022. "Asset selection based on high frequency Sharpe ratio," Journal of Econometrics, Elsevier, vol. 227(1), pages 168-188.
    15. Ghosh Debashis, 2012. "Incorporating the Empirical Null Hypothesis into the Benjamini-Hochberg Procedure," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(4), pages 1-21, July.
    16. Viet Anh Nguyen & Daniel Kuhn & Peyman Mohajerin Esfahani, 2018. "Distributionally Robust Inverse Covariance Estimation: The Wasserstein Shrinkage Estimator," Papers 1805.07194, arXiv.org.
    17. Christian Bongiorno, 2020. "Bootstraps Regularize Singular Correlation Matrices," Working Papers hal-02536278, HAL.
    18. Dean Palejev & Mladen Savov, 2021. "On the Convergence of the Benjamini–Hochberg Procedure," Mathematics, MDPI, vol. 9(17), pages 1-19, September.
    19. Khan, Ashraf & Goodell, John W. & Hassan, M. Kabir & Paltrinieri, Andrea, 2022. "A bibliometric review of finance bibliometric papers," Finance Research Letters, Elsevier, vol. 47(PA).
    20. Moon, H.R. & Perron, B., 2012. "Beyond panel unit root tests: Using multiple testing to determine the nonstationarity properties of individual series in a panel," Journal of Econometrics, Elsevier, vol. 169(1), pages 29-33.

    More about this item

    Keywords

    distributional transform; family-wise error rate; multiple hypotheses testing; multiplicity correction; simultaneous statistical inference; single-step test factor structure; prediction;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hum:wpaper:sfb649dp2012-049. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: RDC-Team (email available below). General contact details of provider: https://edirc.repec.org/data/sohubde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.