IDEAS home Printed from https://ideas.repec.org/a/spr/stpapr/v64y2023i3d10.1007_s00362-022-01337-5.html
   My bibliography  Save this article

Simple powerful robust tests based on sign depth

Author

Listed:
  • Kevin Leckey

    (TU Dortmund University)

  • Dennis Malcherczyk

    (TU Dortmund University)

  • Melanie Horn

    (TU Dortmund University)

  • Christine H. Müller

    (TU Dortmund University)

Abstract

Up to now, powerful outlier robust tests for linear models are based on M-estimators and are quite complicated. On the other hand, the simple robust classical sign test usually provides very bad power for certain alternatives. We present a generalization of the sign test which is similarly easy to comprehend but much more powerful. It is based on K-sign depth, shortly denoted by K-depth. These so-called K-depth tests are motivated by simplicial regression depth, but are not restricted to regression problems. They can be applied as soon as the true model leads to independent residuals with median equal to zero. Moreover, general hypotheses on the unknown parameter vector can be tested. While the 2-depth test, i.e. the K-depth test for $$K = 2$$ K = 2 , is equivalent to the classical sign test, K-depth test with $$K\ge 3$$ K ≥ 3 turn out to be much more powerful in many applications. A drawback of the K-depth test is its fairly high computational effort when implemented naively. However, we show how this inherent computational complexity can be reduced. In order to see why K-depth tests with $$K\ge 3$$ K ≥ 3 are more powerful than the classical sign test, we discuss the asymptotic behavior of its test statistic for residual vectors with only few sign changes, which is in particular the case for some alternatives the classical sign test cannot reject. In contrast, we also consider residual vectors with alternating signs, representing models that fit the data very well. Finally, we demonstrate the good power of the K-depth tests for some examples including high-dimensional multiple regression.

Suggested Citation

  • Kevin Leckey & Dennis Malcherczyk & Melanie Horn & Christine H. Müller, 2023. "Simple powerful robust tests based on sign depth," Statistical Papers, Springer, vol. 64(3), pages 857-882, June.
  • Handle: RePEc:spr:stpapr:v:64:y:2023:i:3:d:10.1007_s00362-022-01337-5
    DOI: 10.1007/s00362-022-01337-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s00362-022-01337-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s00362-022-01337-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liesa Denecke & Christine Müller, 2014. "Consistency of the likelihood depth estimator for the correlation coefficient," Statistical Papers, Springer, vol. 55(1), pages 3-13, February.
    2. Nagy, Stanislav & Ferraty, Frédéric, 2019. "Data depth for measurable noisy random functions," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 95-114.
    3. Gerda Claeskens & Mia Hubert & Leen Slaets & Kaveh Vakili, 2014. "Multivariate Functional Halfspace Depth," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 411-423, March.
    4. Wang, Jin, 2019. "Asymptotics of generalized depth-based spread processes and applications," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 363-380.
    5. Davy Paindaveine & Germain Van bever, 2013. "From Depth to Local Depth: A Focus on Centrality," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 108(503), pages 1105-1119, September.
    6. Wellmann, Robin & Müller, Christine H., 2010. "Tests for multiple regression based on simplicial depth," Journal of Multivariate Analysis, Elsevier, vol. 101(4), pages 824-838, April.
    7. Manuel Koller & Werner A. Stahel, 2017. "Nonsingular subsampling for regression S estimators with categorical predictors," Computational Statistics, Springer, vol. 32(2), pages 631-646, June.
    8. Christoph P. Kustosz & Anne Leucht & Christine H. MÜller, 2016. "Tests Based on Simplicial Depth for AR(1) Models With Explosion," Journal of Time Series Analysis, Wiley Blackwell, vol. 37(6), pages 763-784, November.
    9. Paindaveine, Davy, 2009. "On Multivariate Runs Tests for Randomness," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1525-1538.
    10. Ye Dong & Stephen Lee, 2014. "Depth functions as measures of representativeness," Statistical Papers, Springer, vol. 55(4), pages 1079-1105, November.
    11. Sara López-Pintado & Ying Sun & Juan Lin & Marc Genton, 2014. "Simplicial band depth for multivariate functional data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 8(3), pages 321-338, September.
    12. Koller, Manuel & Stahel, Werner A., 2011. "Sharpening Wald-type inference in robust regression for small samples," Computational Statistics & Data Analysis, Elsevier, vol. 55(8), pages 2504-2515, August.
    13. W. Lok & Stephen Lee, 2011. "A new statistical depth function with applications to multimodal data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 23(3), pages 617-631.
    14. Wellmann, Robin & Harmand, Peter & Müller, Christine H., 2009. "Distribution-free tests for polynomial regression based on simplicial depth," Journal of Multivariate Analysis, Elsevier, vol. 100(4), pages 622-635, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Davy Paindaveine & Germain Van Bever, 2017. "Halfspace Depths for Scatter, Concentration and Shape Matrices," Working Papers ECARES ECARES 2017-19, ULB -- Universite Libre de Bruxelles.
    2. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2015. "Multivariate functional outlier detection," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 177-202, July.
    3. Francesca Ieva & Anna Paganoni, 2015. "Discussion of “multivariate functional outlier detection” by M. Hubert, P. Rousseeuw and P. Segaert," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 217-221, July.
    4. Christoph P. Kustosz & Anne Leucht & Christine H. MÜller, 2016. "Tests Based on Simplicial Depth for AR(1) Models With Explosion," Journal of Time Series Analysis, Wiley Blackwell, vol. 37(6), pages 763-784, November.
    5. Zhuo Qu & Wenlin Dai & Marc G. Genton, 2021. "Robust functional multivariate analysis of variance with environmental applications," Environmetrics, John Wiley & Sons, Ltd., vol. 32(1), February.
    6. Nagy, Stanislav & Ferraty, Frédéric, 2019. "Data depth for measurable noisy random functions," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 95-114.
    7. Francesca Ieva & Anna Maria Paganoni, 2020. "Component-wise outlier detection methods for robustifying multivariate functional samples," Statistical Papers, Springer, vol. 61(2), pages 595-614, April.
    8. Wellmann, Robin & Müller, Christine H., 2010. "Depth notions for orthogonal regression," Journal of Multivariate Analysis, Elsevier, vol. 101(10), pages 2358-2371, November.
    9. Kuhnt, Sonja & Rehage, André, 2016. "An angle-based multivariate functional pseudo-depth for shape outlier detection," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 325-340.
    10. Qiu, Zhiping & Chen, Jianwei & Zhang, Jin-Ting, 2021. "Two-sample tests for multivariate functional data with applications," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    11. Dai, Wenlin & Genton, Marc G., 2019. "Directional outlyingness for multivariate functional data," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 50-65.
    12. Yuan Yan & Marc Genton, 2015. "Discussion of “Multivariate functional outlier detection” by Mia Hubert, Peter Rousseeuw and Pieter Segaert," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 245-251, July.
    13. Weiyi Xie & Sebastian Kurtek & Karthik Bharath & Ying Sun, 2017. "A Geometric Approach to Visualization of Variability in Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 979-993, July.
    14. Sara López-Pintado, 2015. "Discussion of Multivariate functional outlier detection by M. Hubert, P. Rousseeuw and P. Segaert," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 253-256, July.
    15. Christoph Kustosz & Christine Müller, 2014. "Analysis of crack growth with robust, distribution-free estimators and tests for non-stationary autoregressive processes," Statistical Papers, Springer, vol. 55(1), pages 125-140, February.
    16. Zhu, Tianming & Zhang, Jin-Ting & Cheng, Ming-Yen, 2022. "One-way MANOVA for functional data via Lawley–Hotelling trace test," Journal of Multivariate Analysis, Elsevier, vol. 192(C).
    17. Elías, Antonio & Jiménez, Raúl & Shang, Han Lin, 2022. "On projection methods for functional time series forecasting," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    18. Kotík, Lukáš & Hlubinka, Daniel, 2017. "A weighted localization of halfspace depth and its properties," Journal of Multivariate Analysis, Elsevier, vol. 157(C), pages 53-69.
    19. Gijbels, Irène & Nagy, Stanislav, 2015. "Consistency of non-integrated depths for functional data," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 259-282.
    20. Cabana Garceran del Vall, Elisa & Laniado Rodas, Henry & Lillo Rodríguez, Rosa Elvira, 2017. "Multivariate outlier detection based on a robust Mahalanobis distance with shrinkage estimators," DES - Working Papers. Statistics and Econometrics. WS 24613, Universidad Carlos III de Madrid. Departamento de Estadística.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:stpapr:v:64:y:2023:i:3:d:10.1007_s00362-022-01337-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.