IDEAS home Printed from https://ideas.repec.org/p/eca/wpaper/2013-260378.html
   My bibliography  Save this paper

Detecting the Direction of a Signal on High-dimensional Spheres: Non-null and Le Cam Optimality Results

Author

Listed:
  • Davy Paindaveine
  • Thomas Verdebout

Abstract

We consider one of the most important problems in directional statistics, namely the problem of testing the null hypothesis that the spike direction theta of a Fisher-von Mises-Langevin distribution on the p-dimensional unit hypersphere is equal to a given direction theta_0. After a reduction through invariance arguments, we derive local asymptotic normality (LAN) results in a general high-dimensional framework where the dimension p_n goes to infinity at an arbitrary rate with the sample size n, and where the concentration kappa_n behaves in a completely free way with n, which offers a spectrum of problems ranging from arbitrarily easy to arbitrarily challenging ones. We identify seven asymptotic regimes, depending on the convergence/divergence properties of (kappa_n), that yield different contiguity rates and different limiting experiments. In each regime, we derive Le Cam optimal tests under specified kappa_n and we compute, from the Le Cam third lemma, asymptotic powers of the classical Watson test under contiguous alternatives. We further establish LAN results with respect to both spike direction and concentration, which allows us to discuss optimality also under unspecified kappa_n. To obtain a full understanding of the non-null behavior of the Watson test, we use martingale CLTs to derive its local asymptotic powers in the broader, semiparametric, model of rotationally symmetric distributions. A Monte Carlo study shows that the finite-sample behaviors of the various tests remarkably agree with our asymptotic results.

Suggested Citation

  • Davy Paindaveine & Thomas Verdebout, 2017. "Detecting the Direction of a Signal on High-dimensional Spheres: Non-null and Le Cam Optimality Results," Working Papers ECARES ECARES 2017-40, ULB -- Universite Libre de Bruxelles.
  • Handle: RePEc:eca:wpaper:2013/260378
    as

    Download full text from publisher

    File URL: https://dipot.ulb.ac.be/dspace/bitstream/2013/260378/3/2017-40-PAINDAVEINE_VERDEBOUT-detecting.pdf
    File Function: Full text for the whole work, or for a work part
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. R. Arnold & P. E. Jupp, 2013. "Statistics of orthogonal axial frames," Biometrika, Biometrika Trust, vol. 100(3), pages 571-586.
    2. Hornik, Kurt & Grün, Bettina, 2014. "movMF: An R Package for Fitting Mixtures of von Mises-Fisher Distributions," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 58(i10).
    3. P. V. Larsen, 2002. "Improved likelihood ratio tests on the von Mises--Fisher distribution," Biometrika, Biometrika Trust, vol. 89(4), pages 947-951, December.
    4. Davy Paindaveine & Thomas Verdebout, 2013. "Optimal Rank-Based Tests for the Location Parameter of a Rotationally Symmetric Distribution on the Hypersphere," Working Papers ECARES ECARES 2013-36, ULB -- Universite Libre de Bruxelles.
    5. Ley, Christophe & Paindaveine, Davy & Verdebout, Thomas, 2015. "High-dimensional tests for spherical location and spiked covariance," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 79-91.
    6. T. D. Downs, 2003. "Spherical regression," Biometrika, Biometrika Trust, vol. 90(3), pages 655-668, September.
    7. Christine Cutting & Davy Paindaveine & Thomas Verdebout, 2015. "Testing Uniformity on High-Dimensional Spheres against Contiguous Rotationally Symmetric Alternatives," Working Papers ECARES ECARES 2015-04, ULB -- Universite Libre de Bruxelles.
    8. Chikuse, Yasuko, 1991. "High dimensional limit theorems and matrix decompositions on the Stiefel manifold," Journal of Multivariate Analysis, Elsevier, vol. 36(2), pages 145-162, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Arthur Pewsey & Eduardo García-Portugués, 2021. "Recent advances in directional statistics," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(1), pages 1-58, March.
    2. Christine Cutting & Davy Paindaveine & Thomas Verdebout, 2015. "Tests of Concentration for Low-Dimensional and High-Dimensional Directional Data," Working Papers ECARES ECARES 2015-05, ULB -- Universite Libre de Bruxelles.
    3. Anders Bredahl Kock & David Preinerstorfer, 2019. "Power in High‐Dimensional Testing Problems," Econometrica, Econometric Society, vol. 87(3), pages 1055-1069, May.
    4. Davy Paindaveine & Thomas Verdebout, 2013. "Universal Asymptotics for High-Dimensional Sign Tests," Working Papers ECARES ECARES 2013-40, ULB -- Universite Libre de Bruxelles.
    5. Davy Paindaveine & Thomas Verdebout, 2019. "Inference for Spherical Location under High Concentration," Working Papers ECARES 2019-02, ULB -- Universite Libre de Bruxelles.
    6. Ley, Christophe & Paindaveine, Davy & Verdebout, Thomas, 2015. "High-dimensional tests for spherical location and spiked covariance," Journal of Multivariate Analysis, Elsevier, vol. 139(C), pages 79-91.
    7. Felix Mbuga & Cristina Tortora, 2021. "Spectral Clustering of Mixed-Type Data," Stats, MDPI, vol. 5(1), pages 1-11, December.
    8. Kanti V. Mardia, 2021. "Comments on: Recent advances in directional statistics," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(1), pages 59-63, March.
    9. Bee, Marco & Benedetti, Roberto & Espa, Giuseppe, 2017. "Approximate maximum likelihood estimation of the Bingham distribution," Computational Statistics & Data Analysis, Elsevier, vol. 108(C), pages 84-96.
    10. Giovanni Forchini, "undated". "The Geometry of Similar Tests for Structural Change," Discussion Papers 00/55, Department of Economics, University of York.
    11. Feng, Long & Sun, Fasheng, 2015. "A note on high-dimensional two-sample test," Statistics & Probability Letters, Elsevier, vol. 105(C), pages 29-36.
    12. Zhu, Changbo & Müller, Hans-Georg, 2024. "Spherical autoregressive models, with application to distributional and compositional time series," Journal of Econometrics, Elsevier, vol. 239(2).
    13. Watamori, Yoko & Jupp, Peter E., 2005. "Improved likelihood ratio and score tests on concentration parameters of von Mises-Fisher distributions," Statistics & Probability Letters, Elsevier, vol. 72(2), pages 93-102, April.
    14. You, Kisung & Suh, Changhee, 2022. "Parameter estimation and model-based clustering with spherical normal distribution on the unit hypersphere," Computational Statistics & Data Analysis, Elsevier, vol. 171(C).
    15. Giuseppe Pandolfo & Antonio D’ambrosio, 2023. "Clustering directional data through depth functions," Computational Statistics, Springer, vol. 38(3), pages 1487-1506, September.
    16. Eduardo Garcia-Portugues & Davy Paindaveine & Thomas Verdebout, 2020. "On optimal tests for rotational symmetry against new classes of hyperspherical distributions," Post-Print hal-03169388, HAL.
    17. Arnold, R. & Jupp, P.E. & Schaeben, H., 2018. "Statistics of ambiguous rotations," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 73-85.
    18. Christophe Ley & Thomas Verdebout, 2014. "Skew-rotsymmetric Distributions on Unit Spheres and Related Efficient Inferential Proceedures," Working Papers ECARES ECARES 2014-46, ULB -- Universite Libre de Bruxelles.
    19. Dong, Aqi & Melnykov, Volodymyr, 2024. "Contaminated Kent mixture model for clustering non-spherical directional data with heavy tails or scatter," Statistics & Probability Letters, Elsevier, vol. 208(C).
    20. Jupp, P.E. & Regoli, G. & Azzalini, A., 2016. "A general setting for symmetric distributions and their relationship to general distributions," Journal of Multivariate Analysis, Elsevier, vol. 148(C), pages 107-119.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eca:wpaper:2013/260378. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Benoit Pauwels (email available below). General contact details of provider: https://edirc.repec.org/data/arulbbe.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.