IDEAS home Printed from https://ideas.repec.org/p/zbw/ucdpse/112.html
   My bibliography  Save this paper

Fast nonparametric classification based on data depth

Author

Listed:
  • Lange, Tatjana
  • Mosler, Karl
  • Mozharovskyi, Pavlo

Abstract

A new procedure, called DD-procedure, is developed to solve the problem of classifying d-dimensional objects into q Ï 2 classes. The procedure is completely nonparametric; it uses q-dimensional depth plots and a very efficient algorithm for discrimination analysis in the depth space [0, 1]q . Specifically, the depth is the zonoid depth, and the algorithm is the procedure. In case of more than two classes several binary classifications are performed and a majority rule is applied. Special treatments are discussed for outsiders, that is, data having zero depth vector. The DD-classifier is applied to simulated as well as real data, and the results are compared with those of similar procedures that have been recently proposed. In most cases the new procedure has comparable error rates, but is much faster than other classification approaches, including the SVM.

Suggested Citation

  • Lange, Tatjana & Mosler, Karl & Mozharovskyi, Pavlo, 2012. "Fast nonparametric classification based on data depth," Discussion Papers in Econometrics and Statistics 1/12, University of Cologne, Institute of Econometrics and Statistics.
    • Handle: RePEc:zbw:ucdpse:112
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/67614/1/700639101.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christmann, Andreas & Rousseeuw, Peter J., 2001. "Measuring overlap in binary regression," Computational Statistics & Data Analysis, Elsevier, vol. 37(1), pages 65-75, July.
    2. Karl Mosler, 2003. "Central Regions and Dependency," Methodology and Computing in Applied Probability, Springer, vol. 5(1), pages 5-21, March.
    3. Subhajit Dutta & Anil Ghosh, 2012. "On robust classification using projection depth," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(3), pages 657-676, June.
    4. Andreas Christmann & Paul Fischer & Thorsten Joachims, 2002. "Comparison between various regression depth methods and the support vector machine to approximate the minimum number of misclassifications," Computational Statistics, Springer, vol. 17(2), pages 273-287, July.
    5. Jörnsten, Rebecka, 2004. "Clustering and classification based on the L1 data depth," Journal of Multivariate Analysis, Elsevier, vol. 90(1), pages 67-89, July.
    6. Cuesta-Albertos, J.A. & Nieto-Reyes, A., 2008. "The random Tukey depth," Computational Statistics & Data Analysis, Elsevier, vol. 52(11), pages 4979-4988, July.
    7. Hubert, Mia & Van Driessen, Katrien, 2004. "Fast and robust discriminant analysis," Computational Statistics & Data Analysis, Elsevier, vol. 45(2), pages 301-320, March.
    8. Anil K. Ghosh & Probal Chaudhuri, 2005. "On Maximum Depth and Related Classifiers," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 32(2), pages 327-350, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiaohui Liu & Shihua Luo & Yijun Zuo, 2020. "Some results on the computing of Tukey’s halfspace median," Statistical Papers, Springer, vol. 61(1), pages 303-316, February.
    2. Daniel Hlubinka & Irène Gijbels & Marek Omelka & Stanislav Nagy, 2015. "Integrated data depth for smooth functions and its application in supervised classification," Computational Statistics, Springer, vol. 30(4), pages 1011-1031, December.
    3. Stanislav Nagy, 2021. "Halfspace depth does not characterize probability distributions," Statistical Papers, Springer, vol. 62(3), pages 1135-1139, June.
    4. Xinyu Zhou & Wei Wu, 2024. "Statistical Depth in Spatial Point Process," Mathematics, MDPI, vol. 12(4), pages 1-20, February.
    5. Massimo Aria & Antonio D’Ambrosio & Carmela Iorio & Roberta Siciliano & Valentina Cozza, 2020. "Dynamic recursive tree-based partitioning for malignant melanoma identification in skin lesion dermoscopic images," Statistical Papers, Springer, vol. 61(4), pages 1645-1661, August.
    6. Wei Shao & Yijun Zuo, 2020. "Computing the halfspace depth with multiple try algorithm and simulated annealing algorithm," Computational Statistics, Springer, vol. 35(1), pages 203-226, March.
    7. Vencalek, Ondrej & Pokotylo, Oleksii, 2018. "Depth-weighted Bayes classification," Computational Statistics & Data Analysis, Elsevier, vol. 123(C), pages 1-12.
    8. Dyckerhoff, Rainer & Mozharovskyi, Pavlo, 2016. "Exact computation of the halfspace depth," Computational Statistics & Data Analysis, Elsevier, vol. 98(C), pages 19-30.
    9. J. A. Cuesta-Albertos & M. Febrero-Bande & M. Oviedo de la Fuente, 2017. "The $$\hbox {DD}^G$$ DD G -classifier in the functional setting," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 26(1), pages 119-142, March.
    10. Liu, Xiaohui & Rahman, Jafer & Luo, Shihua, 2019. "Generalized and robustified empirical depths for multivariate data," Statistics & Probability Letters, Elsevier, vol. 146(C), pages 70-79.
    11. Wang, Jin, 2019. "Asymptotics of generalized depth-based spread processes and applications," Journal of Multivariate Analysis, Elsevier, vol. 169(C), pages 363-380.
    12. Olusola Samuel Makinde, 2019. "Classification rules based on distribution functions of functional depth," Statistical Papers, Springer, vol. 60(3), pages 629-640, June.
    13. Christophe Denis & Charlotte Dion & Miguel Martinez, 2020. "Consistent procedures for multiclass classification of discrete diffusion paths," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(2), pages 516-554, June.
    14. Kotík, Lukáš & Hlubinka, Daniel, 2017. "A weighted localization of halfspace depth and its properties," Journal of Multivariate Analysis, Elsevier, vol. 157(C), pages 53-69.
    15. Giovanni Saraceno & Claudio Agostinelli, 2021. "Robust multivariate estimation based on statistical depth filters," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(4), pages 935-959, December.
    16. Ye Dong & Stephen Lee, 2014. "Depth functions as measures of representativeness," Statistical Papers, Springer, vol. 55(4), pages 1079-1105, November.
    17. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2017. "Multivariate and functional classification using depth and distance," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 11(3), pages 445-466, September.
    18. Oleksii Pokotylo & Karl Mosler, 2019. "Classification with the pot–pot plot," Statistical Papers, Springer, vol. 60(3), pages 903-931, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nedret Billor & Asheber Abebe & Asuman Turkmen & Sai Nudurupati, 2008. "Classification Based on Depth Transvariations," Journal of Classification, Springer;The Classification Society, vol. 25(2), pages 249-260, November.
    2. Pavlo Mozharovskyi & Karl Mosler & Tatjana Lange, 2015. "Classifying real-world data with the $${ DD}\alpha $$ D D α -procedure," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 9(3), pages 287-314, September.
    3. Anirvan Chakraborty & Probal Chaudhuri, 2014. "On data depth in infinite dimensional spaces," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(2), pages 303-324, April.
    4. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    5. repec:spo:wpmain:info:hdl:2441/3qnaslliat80pbqa8t90240unj is not listed on IDEAS
    6. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2017. "Multivariate and functional classification using depth and distance," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 11(3), pages 445-466, September.
    7. Subhajit Dutta & Anil Ghosh, 2012. "On robust classification using projection depth," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 64(3), pages 657-676, June.
    8. repec:hal:spmain:info:hdl:2441/3qnaslliat80pbqa8t90240unj is not listed on IDEAS
    9. Dyckerhoff, Rainer & Mozharovskyi, Pavlo & Nagy, Stanislav, 2021. "Approximate computation of projection depths," Computational Statistics & Data Analysis, Elsevier, vol. 157(C).
    10. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    11. Vencalek, Ondrej & Pokotylo, Oleksii, 2018. "Depth-weighted Bayes classification," Computational Statistics & Data Analysis, Elsevier, vol. 123(C), pages 1-12.
    12. Davy Paindaveine & Germain Van Bever, 2017. "Halfspace Depths for Scatter, Concentration and Shape Matrices," Working Papers ECARES ECARES 2017-19, ULB -- Universite Libre de Bruxelles.
    13. Mia Hubert & Stephan Van der Veeken, 2010. "Robust classification for skewed data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 4(4), pages 239-254, December.
    14. Olusola Samuel Makinde, 2019. "Classification rules based on distribution functions of functional depth," Statistical Papers, Springer, vol. 60(3), pages 629-640, June.
    15. Karl Mosler & Pavlo Mozharovskyi, 2017. "Fast DD-classification of functional data," Statistical Papers, Springer, vol. 58(4), pages 1055-1089, December.
    16. repec:spo:wpmain:info:hdl:2441/64itsev5509q8aa5mrbhi0g0b6 is not listed on IDEAS
    17. Wei Shao & Yijun Zuo, 2020. "Computing the halfspace depth with multiple try algorithm and simulated annealing algorithm," Computational Statistics, Springer, vol. 35(1), pages 203-226, March.
    18. López Pintado, Sara, 2005. "Depth-based classification for functional data," DES - Working Papers. Statistics and Econometrics. WS ws055611, Universidad Carlos III de Madrid. Departamento de Estadística.
    19. Ondrej Vencalek & Olusola Samuel Makinde, 2021. "RR-classifier: a nonparametric classification procedure in multidimensional space based on relative ranks," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 105(4), pages 675-693, December.
    20. Daniel Hlubinka & Irène Gijbels & Marek Omelka & Stanislav Nagy, 2015. "Integrated data depth for smooth functions and its application in supervised classification," Computational Statistics, Springer, vol. 30(4), pages 1011-1031, December.
    21. Mengta Yang & Reza Modarres, 2017. "Multivariate tests of uniformity," Statistical Papers, Springer, vol. 58(3), pages 627-639, September.
    22. repec:hal:spmain:info:hdl:2441/64itsev5509q8aa5mrbhi0g0b6 is not listed on IDEAS
    23. Yonggang Hu & Yong Wang & Yi Wu & Qiang Li & Chenping Hou, 2011. "Generalized Mahalanobis depth in the reproducing kernel Hilbert space," Statistical Papers, Springer, vol. 52(3), pages 511-522, August.
    24. Gleb A. Koshevoy & Karl Mosler, 2007. "Multivariate Lorenz dominance based on zonoids," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 91(1), pages 57-76, March.

    More about this item

    Keywords

    Alpha-procedure; zonoid depth; DD-plot; pattern recognition; supervised learning; misclassification rate;
    All these keywords.

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:ucdpse:112. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/sxkoede.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.