IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v56y2012i6p1935-1943.html
   My bibliography  Save this article

Adaptive combination of dependent tests

Author

Listed:
  • Sexton, Joseph
  • Blomhoff, Rune
  • Karlsen, Anette
  • Laake, Petter

Abstract

The construction of a multivariate two sample test is considered. An attractive approach to this problem, for instance when the data contain missing values or the number of variables is large, is to form an overall test by combining the componentwise test statistics. This can be done via their p-values or some other transformation. An important problem is how to perform the combination, as the relative power of a given combination will depend on the unknown true alternative. Recently, an approach has been proposed that makes use of the data to identify an appropriate combination. The method forms a pool of potential combinations of the componentwise p-values, setting the overall test statistic to the minimum p-value across the pool. One drawback of the approach, however, is that it does not utilize dependence between the componentwise tests, and thus potentially ignores valuable information. This issue is addressed, and two approaches are described that make use of the data to (1) determine which tests to combine; and (2) how best to utilize the between test statistic dependence. Simulations show that the proposed methods can lead to a substantial increase in power. An application to a dietary intervention study is given.

Suggested Citation

  • Sexton, Joseph & Blomhoff, Rune & Karlsen, Anette & Laake, Petter, 2012. "Adaptive combination of dependent tests," Computational Statistics & Data Analysis, Elsevier, vol. 56(6), pages 1935-1943.
    • Handle: RePEc:eee:csdana:v:56:y:2012:i:6:p:1935-1943
    DOI: 10.1016/j.csda.2011.11.018
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947311004166
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2011.11.018?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yujun Wu & Marc G. Genton & Leonard A. Stefanski, 2006. "A Multivariate Two-Sample Mean Test for Small Sample Size and Missing Data," Biometrics, The International Biometric Society, vol. 62(3), pages 877-885, September.
    2. Salmaso, Luigi & Solari, Aldo, 2006. "Nonparametric iterated combined tests for genetic differentiation," Computational Statistics & Data Analysis, Elsevier, vol. 50(4), pages 1105-1112, February.
    3. Baringhaus, L. & Franz, C., 2004. "On a new multivariate two-sample test," Journal of Multivariate Analysis, Elsevier, vol. 88(1), pages 190-206, January.
    4. Loughin, Thomas M., 2004. "A systematic comparison of methods for combining p-values from independent tests," Computational Statistics & Data Analysis, Elsevier, vol. 47(3), pages 467-485, October.
    5. Marozzi, Marco, 2004. "A bi-aspect nonparametric test for the two-sample location problem," Computational Statistics & Data Analysis, Elsevier, vol. 44(4), pages 639-648, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Marozzi, 2012. "A combined test for differences in scale based on the interquantile range," Statistical Papers, Springer, vol. 53(1), pages 61-72, February.
    2. Masato Okamoto, 2009. "Decomposition of gini and multivariate gini indices," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 7(2), pages 153-177, June.
    3. Alexander Kaever & Manuel Landesfeind & Kirstin Feussner & Burkhard Morgenstern & Ivo Feussner & Peter Meinicke, 2014. "Meta-Analysis of Pathway Enrichment: Combining Independent and Dependent Omics Data Sets," PLOS ONE, Public Library of Science, vol. 9(2), pages 1-12, February.
    4. Biswas, Munmun & Ghosh, Anil K., 2014. "A nonparametric two-sample test applicable to high dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 123(C), pages 160-171.
    5. Modarres, Reza, 2014. "On the interpoint distances of Bernoulli vectors," Statistics & Probability Letters, Elsevier, vol. 84(C), pages 215-222.
    6. Lan Cheng & Xuguang Simon Sheng, 2017. "Combination of “combinations of p values”," Empirical Economics, Springer, vol. 53(1), pages 329-350, August.
    7. Dong, Kai & Pang, Herbert & Tong, Tiejun & Genton, Marc G., 2016. "Shrinkage-based diagonal Hotelling’s tests for high-dimensional small sample size data," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 127-142.
    8. Xuguang Sheng & Jingyun Yang, 2013. "Truncated Product Methods for Panel Unit Root Tests," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 75(4), pages 624-636, August.
    9. Zongliang Hu & Tiejun Tong & Marc G. Genton, 2019. "Diagonal likelihood ratio test for equality of mean vectors in high‐dimensional data," Biometrics, The International Biometric Society, vol. 75(1), pages 256-267, March.
    10. Julian Frank & Bernhard Klar, 2016. "Methods to test for equality of two normal distributions," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 25(4), pages 581-599, November.
    11. Kojadinovic, Ivan, 2010. "Hierarchical clustering of continuous variables based on the empirical copula process and permutation linkages," Computational Statistics & Data Analysis, Elsevier, vol. 54(1), pages 90-108, January.
    12. Doyle, John R. & Chen, Catherine H., 2013. "Patterns in stock market movements tested as random number generators," European Journal of Operational Research, Elsevier, vol. 227(1), pages 122-132.
    13. Mondal, Pronoy K. & Biswas, Munmun & Ghosh, Anil K., 2015. "On high dimensional two-sample tests based on nearest neighbors," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 168-178.
    14. V. Alba Fernández & D. Barrera Rosillo & M. Ibáñez Pérez & M. Jiménez Gamero, 2009. "A homogeneity test for bivariate random variables," Computational Statistics, Springer, vol. 24(3), pages 513-531, August.
    15. Van der Meulen, Sofie & Gaeremynck, Ann & Willekens, Marleen, 2007. "Attribute differences between U.S. GAAP and IFRS earnings: An exploratory study," The International Journal of Accounting, Elsevier, vol. 42(2), pages 123-142.
    16. Yoav Benjamini & Ruth Heller, 2008. "Screening for Partial Conjunction Hypotheses," Biometrics, The International Biometric Society, vol. 64(4), pages 1215-1222, December.
    17. Petrie, Adam, 2016. "Graph-theoretic multisample tests of equality in distribution for high dimensional data," Computational Statistics & Data Analysis, Elsevier, vol. 96(C), pages 145-158.
    18. Brombin, Chiara & Salmaso, Luigi, 2009. "Multi-aspect permutation tests in shape analysis with small sample size," Computational Statistics & Data Analysis, Elsevier, vol. 53(12), pages 3921-3931, October.
    19. Sunil Mathur, 2009. "A new nonparametric bivariate test for two sample location problem," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 18(3), pages 375-388, August.
    20. Chien Li-Chu, 2020. "Combining dependent p-values by gamma distributions," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 19(4-6), pages 1-12, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:56:y:2012:i:6:p:1935-1943. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.