IDEAS home Printed from https://ideas.repec.org/p/eca/wpaper/2013-309233.html
   My bibliography  Save this paper

Rate-Optimality of Consistent Distribution-Free Tests of Independence Based on Center-Outward Ranks and Signs

Author

Listed:
  • Hongjian Shi
  • Marc Hallin
  • Mathias Drton
  • Fang Han

Abstract

Rank correlations have found many innovative applications in the last decade. In particular,suitable versions of rank correlations have been used for consistent tests of independence between pairs of random variables. The use of ranks is especially appealing for continuous data as tests become distribution-free. However, the traditional concept of ranks relies on ordering data and is, thus, tied to univariate observations. As a result it has long remained unclear how one may construct distribution-free yet consistent tests of independence between multivariate random vectors. This is the problem we address in this paper, in which we lay out a general framework for designing dependence measures that give tests of multivariate independence that are not only consistent and distribution-free but which we also prove to be statistically efficient. Our framework leverages the recently introduced concept of center-outward ranks and signs, a multivariate generalization of traditional ranks, and adopts a common standard form for dependence measures that encompasses many popular measures from the literature. In a unified study, we derive a general asymptotic representation of center-outward test statistics under independence, extending to the multivariate setting the classical Hájek asymptotic representation results. This representation permits a direct calculation of limiting null distributions for the proposed test statistics. Moreover, it facilitates a local power analysis that provides strong support for the center-outward approach to multivariate ranks by establishing, for the first time, the rate-optimality of center-outward tests within families of Konijn alternatives.

Suggested Citation

  • Hongjian Shi & Marc Hallin & Mathias Drton & Fang Han, 2020. "Rate-Optimality of Consistent Distribution-Free Tests of Independence Based on Center-Outward Ranks and Signs," Working Papers ECARES 2020-23, ULB -- Universite Libre de Bruxelles.
  • Handle: RePEc:eca:wpaper:2013/309233
    as

    Download full text from publisher

    File URL: https://dipot.ulb.ac.be/dspace/bitstream/2013/309233/3/2020-23-SHI_HALLIN_DRTON_HAN-rate.pdf
    File Function: Full text for the whole work, or for a work part
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Marc Hallin & Gilles Mordant & Johan Segers, 2020. "Multivariate Goodness-of-Fit Tests Based on Wasserstein Distance," Working Papers ECARES 2020-06, ULB -- Universite Libre de Bruxelles.
    2. M. Hallin & D. La Vecchia & H. Liu, 2022. "Center-Outward R-Estimation for Semiparametric VARMA Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 925-938, April.
    3. Taskinen, Sara & Kankainen, Annaliisa & Oja, Hannu, 2003. "Sign test of independence between two random vectors," Statistics & Probability Letters, Elsevier, vol. 62(1), pages 9-21, March.
    4. repec:hal:spmain:info:hdl:2441/64itsev5509q8aa5mrbhi0g0b6 is not listed on IDEAS
    5. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    6. Alexandre Belloni & Victor Chernozhukov & Christian Hansen, 2014. "Inference on Treatment Effects after Selection among High-Dimensional Controlsâ€," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 81(2), pages 608-650.
    7. Marc Hallin, 2017. "On Distribution and Quantile Functions, Ranks and Signs in R_d," Working Papers ECARES ECARES 2017-34, ULB -- Universite Libre de Bruxelles.
    8. Groeneboom,Piet & Jongbloed,Geurt, 2014. "Nonparametric Estimation under Shape Constraints," Cambridge Books, Cambridge University Press, number 9780521864015.
    9. Székely, Gábor J. & Rizzo, Maria L., 2013. "The distance correlation t-test of independence in high dimension," Journal of Multivariate Analysis, Elsevier, vol. 117(C), pages 193-213.
    10. Eustasio Del Barrio & Alberto Gonzalez-Sanz & Marc Hallin, 2019. "A Note on the Regularity of Center-Outward Distribution and Quantile Functions," Working Papers ECARES 2019-33, ULB -- Universite Libre de Bruxelles.
    11. Fang Han & Han Liu, 2018. "ECA: High-Dimensional Elliptical Component Analysis in Non-Gaussian Distributions," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(521), pages 252-268, January.
    12. Leeb, Hannes & Pötscher, Benedikt M., 2008. "Can One Estimate The Unconditional Distribution Of Post-Model-Selection Estimators?," Econometric Theory, Cambridge University Press, vol. 24(2), pages 338-376, April.
    13. Chaudhuri, Arin & Hu, Wenhao, 2019. "A fast algorithm for computing distance correlation," Computational Statistics & Data Analysis, Elsevier, vol. 135(C), pages 15-24.
    14. L Weihs & M Drton & N Meinshausen, 2018. "Symmetric rank covariances: a generalized framework for nonparametric measures of dependence," Biometrika, Biometrika Trust, vol. 105(3), pages 547-562.
    15. Beirlant, J. & Buitendag, S. & del Barrio, E. & Hallin, M. & Kamper, F., 2020. "Center-outward quantiles and the measurement of multivariate risk," Insurance: Mathematics and Economics, Elsevier, vol. 95(C), pages 79-100.
    16. Eustasio Del Barrio & Juan Cuesta Albertos & Marc Hallin & Carlos Matran, 2018. "Smooth Cyclically Monotone Interpolation and Empirical Center-Outward Distribution Functions," Working Papers ECARES 2018-15, ULB -- Universite Libre de Bruxelles.
    17. Fang Han & Shizhe Chen & Han Liu, 2017. "Distribution-free tests of independence in high dimensions," Biometrika, Biometrika Trust, vol. 104(4), pages 813-828.
    18. Liping Zhu & Kai Xu & Runze Li & Wei Zhong, 2017. "Projection correlation between two random vectors," Biometrika, Biometrika Trust, vol. 104(4), pages 829-843.
    19. Taskinen, Sara & Oja, Hannu & Randles, Ronald H., 2005. "Multivariate Nonparametric Tests of Independence," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 916-925, September.
    20. Ruth Heller & Yair Heller & Malka Gorfine, 2013. "A consistent multivariate test of association based on ranks of distances," Biometrika, Biometrika Trust, vol. 100(2), pages 503-510.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. H Shi & M Drton & F Han, 2022. "On the power of Chatterjee’s rank correlation [Adaptive test of independence based on HSIC measures]," Biometrika, Biometrika Trust, vol. 109(2), pages 317-333.
    2. del Barrio, Eustasio & González-Sanz, Alberto & Hallin, Marc, 2020. "A note on the regularity of optimal-transport-based center-outward distribution and quantile functions," Journal of Multivariate Analysis, Elsevier, vol. 180(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hongjian Shi & Mathias Drton & Marc Hallin & Fang Han, 2023. "Semiparametrically Efficient Tests of Multivariate Independence Using Center-Outward Quadrant, Spearman, and Kendall Statistics," Working Papers ECARES 2023-03, ULB -- Universite Libre de Bruxelles.
    2. Eustasio Del Barrio & Alberto Gonzalez-Sanz & Marc Hallin, 2019. "A Note on the Regularity of Center-Outward Distribution and Quantile Functions," Working Papers ECARES 2019-33, ULB -- Universite Libre de Bruxelles.
    3. Marc Hallin & Hongjian Shi & Mathias Drton & Fang Han, 2021. "Center-Outward Sign- and Rank-Based Quadrant, Spearman, and Kendall Tests for Multivariate Independence," Working Papers ECARES 2021-27, ULB -- Universite Libre de Bruxelles.
    4. del Barrio, Eustasio & González-Sanz, Alberto & Hallin, Marc, 2020. "A note on the regularity of optimal-transport-based center-outward distribution and quantile functions," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    5. Beirlant, J. & Buitendag, S. & del Barrio, E. & Hallin, M. & Kamper, F., 2020. "Center-outward quantiles and the measurement of multivariate risk," Insurance: Mathematics and Economics, Elsevier, vol. 95(C), pages 79-100.
    6. Roy, Angshuman & Ghosh, Anil K., 2020. "Some tests of independence based on maximum mean discrepancy and ranks of nearest neighbors," Statistics & Probability Letters, Elsevier, vol. 164(C).
    7. Marc Hallin, 2021. "Measure Transportation and Statistical Decision Theory," Working Papers ECARES 2021-04, ULB -- Universite Libre de Bruxelles.
    8. Marc Hallin, 2018. "From Mahalanobis to Bregman via Monge and Kantorovich towards a “General Generalised Distance”," Working Papers ECARES 2018-12, ULB -- Universite Libre de Bruxelles.
    9. S Gorsky & L Ma, 2022. "Multi-scale Fisher’s independence test for multivariate dependence [A simple measure of conditional dependence]," Biometrika, Biometrika Trust, vol. 109(3), pages 569-587.
    10. Dehghan, Sakineh & Faridrohani, Mohammad Reza, 2024. "A data depth based nonparametric test of independence between two random vectors," Journal of Multivariate Analysis, Elsevier, vol. 202(C).
    11. Angshuman Roy & Anil K. Ghosh & Alok Goswami & C. A. Murthy, 2022. "Some New Copula Based Distribution-free Tests of Independence among Several Random Variables," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 84(2), pages 556-596, August.
    12. Alexandre Belloni & Victor Chernozhukov & Kengo Kato, 2019. "Valid Post-Selection Inference in High-Dimensional Approximately Sparse Quantile Regression Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 749-758, April.
    13. Hallin, Marc & La Vecchia, Davide, 2020. "A Simple R-estimation method for semiparametric duration models," Journal of Econometrics, Elsevier, vol. 218(2), pages 736-749.
    14. Munday, Tim & Brookes, James, 2021. "Mark my words: the transmission of central bank communication to the general public via the print media," Bank of England working papers 944, Bank of England.
    15. M. Hallin & D. La Vecchia & H. Liu, 2022. "Center-Outward R-Estimation for Semiparametric VARMA Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(538), pages 925-938, April.
    16. Zhang, Qingyang, 2019. "Independence test for large sparse contingency tables based on distance correlation," Statistics & Probability Letters, Elsevier, vol. 148(C), pages 17-22.
    17. de Valk, Cees Fouad & Segers, Johan, 2018. "Stability and tail limits of transport-based quantile contours," LIDAM Discussion Papers ISBA 2018031, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    18. Rainer Dyckerhoff & Christophe Ley & Davy Paindaveine, 2014. "Depth-Based Runs Tests for bivariate Central Symmetry," Working Papers ECARES ECARES 2014-03, ULB -- Universite Libre de Bruxelles.
    19. Ivair R. Silva & Yan Zhuang & Julio C. A. da Silva Junior, 2022. "Kronecker delta method for testing independence between two vectors in high-dimension," Statistical Papers, Springer, vol. 63(2), pages 343-365, April.
    20. Damian Kozbur, 2017. "Testing-Based Forward Model Selection," American Economic Review, American Economic Association, vol. 107(5), pages 266-269, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eca:wpaper:2013/309233. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benoit Pauwels (email available below). General contact details of provider: https://edirc.repec.org/data/arulbbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.