IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v117y2018icp128-137.html

Testing independence in high dimensions using Kendall’s tau

Author

Listed:
  • Mao, Guangyu

Abstract

To check the total independence of a random vector without Gaussian assumption in high dimensions, Leung and Drton (forthcoming) recently developed a test by virtue of pairwise Kendall’s taus. However, as their simulation shows, the test suffers from noticeable size distortion when the sample size is small. The present paper provides a theoretical explanation about this phenomenon, and accordingly proposes a new test. The new test can be justified when both the dimension and the sample size go to infinity simultaneously, and moreover, it can be even justified when the dimension tends to infinity but the sample size is fixed, which implies that the test can perform well in the cases of small sample size. Simulation studies confirm the theoretical findings, and show that the newly proposed test can bring remarkable improvement. To illustrate the use of the new test, a real data set is also analyzed.

Suggested Citation

  • Mao, Guangyu, 2018. "Testing independence in high dimensions using Kendall’s tau," Computational Statistics & Data Analysis, Elsevier, vol. 117(C), pages 128-137.
  • Handle: RePEc:eee:csdana:v:117:y:2018:i:c:p:128-137
    DOI: 10.1016/j.csda.2017.07.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947317301743
    Download Restriction: Full text for ScienceDirect subscribers only.

    File URL: https://libkey.io/10.1016/j.csda.2017.07.012?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Mao, Guangyu, 2014. "A new test of independence for high-dimensional data," Statistics & Probability Letters, Elsevier, vol. 93(C), pages 14-18.
    2. Peter Hall & J. S. Marron & Amnon Neeman, 2005. "Geometric representation of high dimension, low sample size data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(3), pages 427-444, June.
    3. Guangyu Mao, 2017. "Robust test for independence in high dimensions," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 46(20), pages 10036-10050, October.
    4. James R. Schott, 2005. "Testing for complete independence in high dimensions," Biometrika, Biometrika Trust, vol. 92(4), pages 951-956, December.
    5. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    6. Srivastava, Muni S. & Kollo, Tõnu & von Rosen, Dietrich, 2011. "Some tests for the covariance matrix with fewer observations than the dimension under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 102(6), pages 1090-1103, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guillaume Marrelec & Alain Giron, 2024. "Inferring the finest pattern of mutual independence from data," Statistical Papers, Springer, vol. 65(3), pages 1677-1702, May.
    2. Jone Ascorbebeitia & Eva Ferreira & Susan Orbe, 2022. "Correction to: Testing conditional multivariate rank correlations: the effect of institutional quality on factors influencing competitiveness," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(4), pages 1167-1167, December.
    3. Feng, Long & Zhao, Ping & Ding, Yanling & Liu, Binghui, 2021. "Rank-based tests of cross-sectional dependence in panel data models," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    4. Kai Xu & Minghui Yang, 2025. "A distance covariance test of independence in high dimension, low sample size contexts," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 77(5), pages 731-755, October.
    5. Xu, Kai & Cheng, Qing & He, Daojiang, 2025. "On summed nonparametric dependence measures in high dimensions, fixed or large samples," Computational Statistics & Data Analysis, Elsevier, vol. 205(C).
    6. Long Feng & Yanling Ding & Binghui Liu, 2020. "Rank‐based Tests for Cross‐sectional Dependence in Large (N, T) Fixed Effects Panel Data Models," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 82(5), pages 1198-1216, October.
    7. Ivair R. Silva & Yan Zhuang & Julio C. A. da Silva Junior, 2022. "Kronecker delta method for testing independence between two vectors in high-dimension," Statistical Papers, Springer, vol. 63(2), pages 343-365, April.
    8. He, Daojiang & Liu, Huanyu & Xu, Kai & Cao, Mingxiang, 2021. "Generalized Schott type tests for complete independence in high dimensions," Journal of Multivariate Analysis, Elsevier, vol. 183(C).
    9. Yuangang Li & Maohua Sun & Guanghui Yuan & Yujing Liu, 2019. "Evaluation Methods of Water Environment Safety and Their Application to the Three Northeast Provinces of China," Sustainability, MDPI, vol. 11(18), pages 1-16, September.
    10. Deng, Wenli & Wang, Jinglong & Zhang, Riquan, 2022. "Measures of concordance and testing of independence in multivariate structure," Journal of Multivariate Analysis, Elsevier, vol. 191(C).
    11. Liqi Xia & Ruiyuan Cao & Jiang Du & Jun Dai, 2025. "Consistent complete independence test in high dimensions based on Chatterjee correlation coefficient," Statistical Papers, Springer, vol. 66(1), pages 1-32, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. He, Daojiang & Liu, Huanyu & Xu, Kai & Cao, Mingxiang, 2021. "Generalized Schott type tests for complete independence in high dimensions," Journal of Multivariate Analysis, Elsevier, vol. 183(C).
    2. Mao, Guangyu, 2015. "A note on testing complete independence for high dimensional data," Statistics & Probability Letters, Elsevier, vol. 106(C), pages 82-85.
    3. Guillaume Marrelec & Alain Giron, 2024. "Inferring the finest pattern of mutual independence from data," Statistical Papers, Springer, vol. 65(3), pages 1677-1702, May.
    4. Wang, Guanghui & Zou, Changliang & Wang, Zhaojun, 2013. "A necessary test for complete independence in high dimensions using rank-correlations," Journal of Multivariate Analysis, Elsevier, vol. 121(C), pages 224-232.
    5. Long Feng & Changliang Zou & Zhaojun Wang, 2016. "Multivariate-Sign-Based High-Dimensional Tests for the Two-Sample Location Problem," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 721-735, April.
    6. Masashi Hyodo & Nobumichi Shutoh & Takahiro Nishiyama & Tatjana Pavlenko, 2015. "Testing block-diagonal covariance structure for high-dimensional data," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 69(4), pages 460-482, November.
    7. Kai Xu & Minghui Yang, 2025. "A distance covariance test of independence in high dimension, low sample size contexts," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 77(5), pages 731-755, October.
    8. Xu, Kai & Cheng, Qing & He, Daojiang, 2025. "On summed nonparametric dependence measures in high dimensions, fixed or large samples," Computational Statistics & Data Analysis, Elsevier, vol. 205(C).
    9. Yamada, Yuki & Hyodo, Masashi & Nishiyama, Takahiro, 2017. "Testing block-diagonal covariance structure for high-dimensional data under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 305-316.
    10. Aki Ishii & Kazuyoshi Yata & Makoto Aoshima, 2021. "Hypothesis tests for high-dimensional covariance structures," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 599-622, June.
    11. Liqi Xia & Ruiyuan Cao & Jiang Du & Jun Dai, 2025. "Consistent complete independence test in high dimensions based on Chatterjee correlation coefficient," Statistical Papers, Springer, vol. 66(1), pages 1-32, January.
    12. Jinan Liu & Apostolos Serletis, 2023. "Volatility and dependence in energy markets," Journal of Economics and Finance, Springer;Academy of Economics and Finance, vol. 47(1), pages 15-37, March.
    13. Bierens, H.J. & Broersma, L., 1991. "The relation between unemployment and interest rate : some international evidence," Serie Research Memoranda 0112, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    14. Halldén, Filip & Hultberg, Anna & Ahmed, Ali & Uddin, Gazi Salah & Yahya, Muhammad & Troster, Victor, 2025. "The role of institutional quality on public renewable energy investments," Renewable and Sustainable Energy Reviews, Elsevier, vol. 215(C).
    15. Juncal Cunado & David Gabauer & Rangan Gupta, 2024. "Realized volatility spillovers between energy and metal markets: a time-varying connectedness approach," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-17, December.
    16. Srivastava, Muni S. & Kollo, Tõnu & von Rosen, Dietrich, 2011. "Some tests for the covariance matrix with fewer observations than the dimension under non-normality," Journal of Multivariate Analysis, Elsevier, vol. 102(6), pages 1090-1103, July.
    17. Amendola, Alessandra & Niglio, Marcella & Vitale, Cosimo, 2006. "The moments of SETARMA models," Statistics & Probability Letters, Elsevier, vol. 76(6), pages 625-633, March.
    18. Elie Bouri & Georges Azzi, 2014. "On the Dynamic Transmission of Mean and Volatility across the Arab Stock Markets," Journal of Emerging Market Finance, Institute for Financial Management and Research, vol. 13(3), pages 279-304, December.
    19. Raul Anibal Feliz & John H. Welch, 1992. "Cointegration and tests of a classical model of inflation in Argentina, Bolivia, Brazil, Mexico, And Peru," Working Papers 9210, Federal Reserve Bank of Dallas.
    20. Elie Bouri & Mahdi Ghaemi Asl & Sahar Darehshiri & David Gabauer, 2024. "Asymmetric connectedness between conventional and Islamic cryptocurrencies: Evidence from good and bad volatility spillovers," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 10(1), pages 1-26, December.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:117:y:2018:i:c:p:128-137. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.