IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v26y2017i4d10.1007_s11749-017-0533-7.html
   My bibliography  Save this article

Testing and support recovery of multiple high-dimensional covariance matrices with false discovery rate control

Author

Listed:
  • Yin Xia

    (Fudan University)

Abstract

Motivated by applications in genomics, we study in this paper four interrelated high-dimensional hypothesis testing problems on dependence structures among multiple populations. A new test statistic is constructed for testing the global hypothesis that multiple covariance matrices are equal, and its limiting null distribution is established. Correction methods are introduced to improve the accuracy of the test for finite samples. It is shown that the proposed tests are powerful against sparse alternatives and enjoy certain optimality properties. We then propose a multiple testing procedure for simultaneously testing the equality of the entries of the covariance matrices across multiple populations. The proposed method is shown to control the false discovery rate. A simulation study demonstrates that the proposed tests maintain the desired error rates under the null and have good power under the alternative. The methods are also applied to a Novartis multi-tissue analysis. In addition, testing and support recovery of submatrices of multiple covariance matrices are studied.

Suggested Citation

  • Yin Xia, 2017. "Testing and support recovery of multiple high-dimensional covariance matrices with false discovery rate control," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(4), pages 782-801, December.
    • Handle: RePEc:spr:testjl:v:26:y:2017:i:4:d:10.1007_s11749-017-0533-7
    DOI: 10.1007/s11749-017-0533-7
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11749-017-0533-7
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11749-017-0533-7?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Yin Xia & Tianxi Cai & T. Tony Cai, 2015. "Testing differential networks with applications to the detection of gene-gene interactions," Biometrika, Biometrika Trust, vol. 102(2), pages 247-266.
    2. Shen, Yanfeng & Lin, Zhengyan & Zhu, Jun, 2011. "Shrinkage-based regularization tests for high-dimensional data with application to gene set analysis," Computational Statistics & Data Analysis, Elsevier, vol. 55(7), pages 2221-2233, July.
    3. Srivastava, Muni S. & Yanagihara, Hirokazu, 2010. "Testing the equality of several covariance matrices with fewer observations than the dimension," Journal of Multivariate Analysis, Elsevier, vol. 101(6), pages 1319-1329, July.
    4. Tony Cai & Weidong Liu & Yin Xia, 2013. "Two-Sample Covariance Matrix Testing and Support Recovery in High-Dimensional and Sparse Settings," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(501), pages 265-277, March.
    5. Wenguang Sun & T. Tony Cai, 2009. "Large‐scale multiple testing under dependence," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 393-424, April.
    6. T. Tony Cai & Weidong Liu, 2016. "Large-Scale Multiple Testing of Correlations," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 229-240, March.
    7. Wenguang Sun & Brian J. Reich & T. Tony Cai & Michele Guindani & Armin Schwartzman, 2015. "False discovery control in large-scale spatial multiple testing," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(1), pages 59-83, January.
    8. John D. Storey & Jonathan E. Taylor & David Siegmund, 2004. "Strong control, conservative point estimation and simultaneous conservative consistency of false discovery rates: a unified approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(1), pages 187-205, February.
    9. Chen, Songxi, 2012. "Two Sample Tests for High Dimensional Covariance Matrices," MPRA Paper 46026, University Library of Munich, Germany.
    10. Cai, T. Tony & Xia, Yin, 2014. "High-dimensional sparse MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 131(C), pages 174-196.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wessel N. van Wieringen & Carel F. W. Peeters & Renee X. de Menezes & Mark A. van de Wiel, 2018. "Testing for pathway (in)activation by using Gaussian graphical models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 67(5), pages 1419-1436, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Xin & Yang, Dan & Xu, Yan & Xia, Yin & Wang, Dong & Shen, Haipeng, 2023. "Testing and support recovery of correlation structures for matrix-valued observations with an application to stock market data," Journal of Econometrics, Elsevier, vol. 232(2), pages 544-564.
    2. Chen, Song Xi & Guo, Bin & Qiu, Yumou, 2023. "Testing and signal identification for two-sample high-dimensional covariances via multi-level thresholding," Journal of Econometrics, Elsevier, vol. 235(2), pages 1337-1354.
    3. Jinyuan Chang & Wen Zhou & Wen-Xin Zhou & Lan Wang, 2017. "Comparing large covariance matrices under weak conditions on the dependence structure and its application to gene clustering," Biometrics, The International Biometric Society, vol. 73(1), pages 31-41, March.
    4. Jiang Hu & Zhidong Bai & Chen Wang & Wei Wang, 2017. "On testing the equality of high dimensional mean vectors with unequal covariance matrices," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(2), pages 365-387, April.
    5. Zhidong Bai & Jiang Hu & Chen Wang & Chao Zhang, 2021. "Test on the linear combinations of covariance matrices in high-dimensional data," Statistical Papers, Springer, vol. 62(2), pages 701-719, April.
    6. Tao Zhang & Zhiwen Wang & Yanling Wan, 2021. "Functional test for high-dimensional covariance matrix, with application to mitochondrial calcium concentration," Statistical Papers, Springer, vol. 62(3), pages 1213-1230, June.
    7. Cai, T. Tony & Zhang, Anru, 2016. "Inference for high-dimensional differential correlation matrices," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 107-126.
    8. Li, Weiming & Qin, Yingli, 2014. "Hypothesis testing for high-dimensional covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 128(C), pages 108-119.
    9. Jianqing Fan & Xu Han, 2017. "Estimation of the false discovery proportion with unknown dependence," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(4), pages 1143-1164, September.
    10. Ghosh Debashis, 2012. "Incorporating the Empirical Null Hypothesis into the Benjamini-Hochberg Procedure," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 11(4), pages 1-21, July.
    11. He, Daojiang & Liu, Huanyu & Xu, Kai & Cao, Mingxiang, 2021. "Generalized Schott type tests for complete independence in high dimensions," Journal of Multivariate Analysis, Elsevier, vol. 183(C).
    12. Sairam Rayaprolu & Zhiyi Chi, 2021. "False Discovery Variance Reduction in Large Scale Simultaneous Hypothesis Tests," Methodology and Computing in Applied Probability, Springer, vol. 23(3), pages 711-733, September.
    13. Du, Lilun & Lan, Wei & Luo, Ronghua & Zhong, Pingshou, 2018. "Factor-adjusted multiple testing of correlations," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 34-47.
    14. Zhang, Jin-Ting & Zhu, Tianming, 2022. "A new normal reference test for linear hypothesis testing in high-dimensional heteroscedastic one-way MANOVA," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    15. T. Tony Cai & Weidong Liu, 2016. "Large-Scale Multiple Testing of Correlations," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 229-240, March.
    16. Thulin, Måns, 2014. "A high-dimensional two-sample test for the mean using random subspaces," Computational Statistics & Data Analysis, Elsevier, vol. 74(C), pages 26-38.
    17. Kong Xin-Bing & Xu Qin-Feng, 2015. "On False Discovery and Non-discovery Proportions of the Dynamic Adaptive Procedure," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 42(2), pages 530-544, June.
    18. Zhang, Yangchun & Zhou, Yirui & Liu, Xiaowei, 2023. "Applications on linear spectral statistics of high-dimensional sample covariance matrix with divergent spectrum," Computational Statistics & Data Analysis, Elsevier, vol. 178(C).
    19. Qingyun Cai & Hock Peng Chan, 2017. "A Double Application of the Benjamini-Hochberg Procedure for Testing Batched Hypotheses," Methodology and Computing in Applied Probability, Springer, vol. 19(2), pages 429-443, June.
    20. Noirrit Kiran Chandra & Sourabh Bhattacharya, 2021. "Asymptotic theory of dependent Bayesian multiple testing procedures under possible model misspecification," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(5), pages 891-920, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:26:y:2017:i:4:d:10.1007_s11749-017-0533-7. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.