IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2609.27200.html

Local Optimality and Rigidity of Frobenius Tests for Dense High-Dimensional Covariance Alternatives

Author

Listed:
  • Peter Reinhard Hansen
  • Werner Ploberger
  • Chen Tong

Abstract

We study identity testing for high-dimensional covariance matrices against dense alternatives of unknown direction, with $p/n \to \gamma$. Along a globally positive quadratic precision path, mixing Gaussian alternatives over a Gaussian Orthogonal Ensemble direction yields a contiguous experiment whose log likelihood reduces to the corrected Frobenius statistic; its upper-tail test attains the limiting weighted-power envelope at every fixed strength. Fixing the prior's Frobenius radius perturbs the mixture by only $O(p^{-1/2})$ in total variation, and exact whitening carries the experiment, the statistic, and its null law to any known null covariance. Separately, under a product-coordinate null, feasibility needs only $4+\eta$ moments, plus identical distributions over time when means are estimated; studentization and an exact degrees-of-freedom correction preserve the local power. A stability inequality turns near-envelope attainment into null agreement with the Frobenius rule, so uniform noninferiority on the typical dense bulk precludes gains at any contiguous alternative. For trace-matched rank-one alternatives, the corrected statistic is the first likelihood direction when $\vartheta_n \to 0$ and $n\vartheta_n \to \infty$; at fixed strength, the log likelihood ratio in the Onatski-Moreira-Hallin fixed-spike benchmark is governed by a richer linear spectral statistic below the Baik-Ben Arous-Peche threshold, while eigenvalue separation permits cost-free largest-eigenvalue enhancement above it. Simulations illustrate the theory.

Suggested Citation

  • Peter Reinhard Hansen & Werner Ploberger & Chen Tong, 2026. "Local Optimality and Rigidity of Frobenius Tests for Dense High-Dimensional Covariance Alternatives," Papers 2609.27200, arXiv.org.
  • Handle: RePEc:arx:papers:2609.27200
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2609.27200
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Graham Elliott & Ulrich K. Müller & Mark W. Watson, 2015. "Nearly Optimal Tests When a Nuisance Parameter Is Present Under the Null Hypothesis," Econometrica, Econometric Society, vol. 83, pages 771-811, March.
    2. James R. Schott, 2005. "Testing for complete independence in high dimensions," Biometrika, Biometrika Trust, vol. 92(4), pages 951-956, December.
    3. Bredahl Kock, Anders & Preinerstorfer, David, 2024. "Superconsistency Of Tests In High Dimensions," Econometric Theory, Cambridge University Press, vol. 40(3), pages 688-704, June.
    4. Xiufan Yu & Danning Li & Lingzhou Xue, 2024. "Fisher’s Combined Probability Test for High-Dimensional Covariance Matrices," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 119(545), pages 511-524, January.
    5. Chen, Song Xi & Zhang, Li-Xin & Zhong, Ping-Shou, 2010. "Tests for High-Dimensional Covariance Matrices," Journal of the American Statistical Association, American Statistical Association, vol. 105(490), pages 810-819.
    6. Xiong, Xiaoge, 2025. "New tests for the identity and sphericity of high-dimensional covariance matrices via U-statistics," Computational Statistics & Data Analysis, Elsevier, vol. 212(C).
    7. Andrews, Donald W K & Ploberger, Werner, 1994. "Optimal Tests When a Nuisance Parameter Is Present Only under the Alternative," Econometrica, Econometric Society, vol. 62(6), pages 1383-1414, November.
    8. Anders Bredahl Kock & David Preinerstorfer, 2019. "Power in High‐Dimensional Testing Problems," Econometrica, Econometric Society, vol. 87(3), pages 1055-1069, May.
    9. Jianqing Fan & Yuan Liao & Jiawei Yao, 2015. "Power Enhancement in High‐Dimensional Cross‐Sectional Tests," Econometrica, Econometric Society, vol. 83(4), pages 1497-1541, July.
    10. Baik, Jinho & Silverstein, Jack W., 2006. "Eigenvalues of large sample covariance matrices of spiked population models," Journal of Multivariate Analysis, Elsevier, vol. 97(6), pages 1382-1408, July.
    11. Marine Carrasco & Liang Hu & Werner Ploberger, 2014. "Optimal Test for Markov Switching Parameters," Econometrica, Econometric Society, vol. 82(2), pages 765-784, March.
    12. Alexei Onatski, 2009. "Testing Hypotheses About the Number of Factors in Large Factor Models," Econometrica, Econometric Society, vol. 77(5), pages 1447-1479, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guo, Wenwen & Cui, Hengjian, 2019. "Projection tests for high-dimensional spiked covariance matrices," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 21-32.
    2. Abhimanyu Gupta & Myung Hwan Seo, 2023. "Robust Inference on Infinite and Growing Dimensional Time‐Series Regression," Econometrica, Econometric Society, vol. 91(4), pages 1333-1361, July.
    3. Li, Kunpeng & Lin, Wei, 2024. "Threshold spatial autoregressive model," Journal of Econometrics, Elsevier, vol. 244(1).
    4. Werker, Bas J.M. & Zhou, B., 2022. "Semiparametric testing with highly persistent predictors," Other publications TiSEM 2974ce9c-97c1-44cd-9331-0, Tilburg University, School of Economics and Management.
    5. Wang, Yulong & Xiao, Zhijie, 2022. "Estimation and inference about tail features with tail censored data," Journal of Econometrics, Elsevier, vol. 230(2), pages 363-387.
    6. Forzani, Liliana & Gieco, Antonella & Tolmasky, Carlos, 2017. "Likelihood ratio test for partial sphericity in high and ultra-high dimensions," Journal of Multivariate Analysis, Elsevier, vol. 159(C), pages 18-38.
    7. Fatemeh Salimi Namin, 2020. "Exchange Rates, Stock Prices, and Stock Market Uncertainty," AMSE Working Papers 2037, Aix-Marseille School of Economics, France.
    8. Peng, Liuhua & Chen, Song Xi & Zhou, Wen, 2016. "More powerful tests for sparse high-dimensional covariances matrices," Journal of Multivariate Analysis, Elsevier, vol. 149(C), pages 124-143.
    9. Kees Jan van Garderen & Noud van Giersbergen, 2020. "A Nearly Similar Powerful Test for Mediation," Papers 2012.11342, arXiv.org, revised Jan 2022.
    10. Peng, Hanxiang & Schick, Anton, 2018. "Asymptotic normality of quadratic forms with random vectors of increasing dimension," Journal of Multivariate Analysis, Elsevier, vol. 164(C), pages 22-39.
    11. Philipp Ketz & Adam McCloskey & Jan Scherer, 2025. "Numerical Analysis of Test Optimality," Papers 2512.19843, arXiv.org.
    12. Werker, Bas J.M. & Zhou, Bo, 2022. "Semiparametric testing with highly persistent predictors," Journal of Econometrics, Elsevier, vol. 227(2), pages 347-370.
    13. Phillip Heiler & Michael C. Knaus, 2025. "Heterogeneity Analysis with Heterogeneous Treatments," Papers 2507.01517, arXiv.org, revised Feb 2026.
    14. Qiu, Yumou & Chen, Songxi, 2012. "Test for Bandedness of High Dimensional Covariance Matrices with Bandwidth Estimation," MPRA Paper 46242, University Library of Munich, Germany.
    15. Bas Werker & Bo Zhou, 2020. "Semiparametric Testing with Highly Persistent Predictors," Papers 2009.08291, arXiv.org.
    16. Fu, Zhonghao & Gao, Shang & Su, Liangjun & Wang, Xia, 2026. "High-dimensional conditional factor model," Journal of Econometrics, Elsevier, vol. 254(PB).
    17. Odendahl, Florens & Rossi, Barbara & Sekhposyan, Tatevik, 2023. "Evaluating forecast performance with state dependence," Journal of Econometrics, Elsevier, vol. 237(2).
    18. Deo, Rohit S., 2016. "On the Tracy–Widom approximation of studentized extreme eigenvalues of Wishart matrices," Journal of Multivariate Analysis, Elsevier, vol. 147(C), pages 265-272.
    19. Xia, Liqi & Cao, Ruiyuan & Du, Jiang & Liu, Ling, 2026. "Rank-based combination independence tests for high-dimensional data," Journal of Multivariate Analysis, Elsevier, vol. 212(C).
    20. Yukun Liu & Changliang Zou & Zhaojun Wang, 2013. "Calibration of the empirical likelihood for high-dimensional data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 65(3), pages 529-550, June.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2609.27200. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.