IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v235y2015i1p85-10110.1007-s10479-015-1956-8.html
   My bibliography  Save this article

Nearest neighbors methods for support vector machines

Author

Listed:
  • S. Camelo
  • M. González-Lima
  • A. Quiroz

Abstract

A key issue in the practical applicability of the support vector machine methodology is the identification of the support vectors in very large data sets, a problem to which a great deal of attention has been given in the literature. In the present article we propose methods based on sampling and nearest neighbors, that allow for an efficient implementation of an approximate solution to the classification problem and, at least in some problems, will help in identifying a significant fraction of the support vectors in large data sets at low cost. The performance of the proposed method is evaluated in different examples and some of its theoretical properties are discussed. Copyright Springer Science+Business Media New York 2015

Suggested Citation

  • S. Camelo & M. González-Lima & A. Quiroz, 2015. "Nearest neighbors methods for support vector machines," Annals of Operations Research, Springer, vol. 235(1), pages 85-101, December.
    • Handle: RePEc:spr:annopr:v:235:y:2015:i:1:p:85-101:10.1007/s10479-015-1956-8
    DOI: 10.1007/s10479-015-1956-8
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10479-015-1956-8
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10479-015-1956-8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Brito, María R. & Quiroz, Adolfo J. & Yukich, J. E., 2002. "Graph-Theoretic Procedures for Dimension Identification," Journal of Multivariate Analysis, Elsevier, vol. 81(1), pages 67-84, April.
    2. Brito, M. R. & Chávez, E. L. & Quiroz, A. J. & Yukich, J. E., 1997. "Connectivity of the mutual k-nearest-neighbor graph in clustering and outlier detection," Statistics & Probability Letters, Elsevier, vol. 35(1), pages 33-42, August.
    3. Brito, M.R. & Quiroz, A.J. & Yukich, J.E., 2013. "Intrinsic dimension identification via graph-theoretic methods," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 263-277.
    4. Asa Ben-Hur & Cheng Soon Ong & Sören Sonnenburg & Bernhard Schölkopf & Gunnar Rätsch, 2008. "Support Vector Machines and Kernels for Computational Biology," PLOS Computational Biology, Public Library of Science, vol. 4(10), pages 1-10, October.
    5. Luca Zanni, 2006. "An Improved Gradient Projection-based Decomposition Technique for Support Vector Machines," Computational Management Science, Springer, vol. 3(2), pages 131-145, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Roberto Bárcenas & Maria Gonzalez-Lima & Joaquin Ortega & Adolfo Quiroz, 2022. "On Subsampling Procedures for Support Vector Machines," Mathematics, MDPI, vol. 10(20), pages 1-27, October.
    2. Pablo Aparicio-Ruiz & Elena Barbadilla-Martín & José Guadix & Pablo Cortés, 2021. "KNN and adaptive comfort applied in decision making for HVAC systems," Annals of Operations Research, Springer, vol. 303(1), pages 217-231, August.
    3. Maria D. Gonzalez-Lima & Carenne C. Ludeña, 2022. "Using Locality-Sensitive Hashing for SVM Classification of Large Data Sets," Mathematics, MDPI, vol. 10(11), pages 1-21, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Díaz, Mateo & Quiroz, Adolfo J. & Velasco, Mauricio, 2019. "Local angles and dimension estimation from data on manifolds," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 229-247.
    2. Nie, Chun-Xiao, 2020. "Correlation dynamics in the cryptocurrency market based on dimensionality reduction analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 554(C).
    3. Ahmed Shamsul Arefin & Carlos Riveros & Regina Berretta & Pablo Moscato, 2012. "GPU-FS-kNN: A Software Tool for Fast and Scalable kNN Computation Using GPUs," PLOS ONE, Public Library of Science, vol. 7(8), pages 1-13, August.
    4. Kay H Brodersen & Thomas M Schofield & Alexander P Leff & Cheng Soon Ong & Ekaterina I Lomakina & Joachim M Buhmann & Klaas E Stephan, 2011. "Generative Embedding for Model-Based Classification of fMRI Data," PLOS Computational Biology, Public Library of Science, vol. 7(6), pages 1-19, June.
    5. Shweta Bhandare & Debra S Goldberg & Robin Dowell, 2017. "Discriminating between HuR and TTP binding sites using the k-spectrum kernel method," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-14, March.
    6. Nie, Chun-Xiao, 2022. "Analysis of critical events in the correlation dynamics of cryptocurrency market," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 586(C).
    7. Valeria Ruggiero & Thomas Serafini & Riccardo Zanella & Luca Zanni, 2010. "Iterative regularization algorithms for constrained image deblurring on graphics processors," Journal of Global Optimization, Springer, vol. 48(1), pages 145-157, September.
    8. Leonardo Galli & Alessandro Galligari & Marco Sciandrone, 2020. "A unified convergence framework for nonmonotone inexact decomposition methods," Computational Optimization and Applications, Springer, vol. 75(1), pages 113-144, January.
    9. Marina M -C Vidovic & Nico Görnitz & Klaus-Robert Müller & Gunnar Rätsch & Marius Kloft, 2015. "SVM2Motif—Reconstructing Overlapping DNA Sequence Motifs by Mimicking an SVM Predictor," PLOS ONE, Public Library of Science, vol. 10(12), pages 1-23, December.
    10. A Ivanenko & P Watkins & M A J van Gerven & K Hammerschmidt & B Englitz, 2020. "Classifying sex and strain from mouse ultrasonic vocalizations using deep learning," PLOS Computational Biology, Public Library of Science, vol. 16(6), pages 1-27, June.
    11. Brito, María R. & Quiroz, Adolfo J. & Yukich, J. E., 2002. "Graph-Theoretic Procedures for Dimension Identification," Journal of Multivariate Analysis, Elsevier, vol. 81(1), pages 67-84, April.
    12. Marina M -C Vidovic & Marius Kloft & Klaus-Robert Müller & Nico Görnitz, 2017. "ML2Motif—Reliable extraction of discriminative sequence motifs from learning machines," PLOS ONE, Public Library of Science, vol. 12(3), pages 1-22, March.
    13. Juan A G Ranea & Ian Morilla & Jon G Lees & Adam J Reid & Corin Yeats & Andrew B Clegg & Francisca Sanchez-Jimenez & Christine Orengo, 2010. "Finding the “Dark Matter” in Human and Yeast Protein Network Prediction and Modelling," PLOS Computational Biology, Public Library of Science, vol. 6(9), pages 1-14, September.
    14. Yong-Jing Hao & Ying-Lian Gao & Mi-Xiao Hou & Ling-Yun Dai & Jin-Xing Liu, 2019. "Hypergraph Regularized Discriminative Nonnegative Matrix Factorization on Sample Classification and Co-Differentially Expressed Gene Selection," Complexity, Hindawi, vol. 2019, pages 1-12, August.
    15. Takaya Saito & Marc Rehmsmeier, 2015. "The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets," PLOS ONE, Public Library of Science, vol. 10(3), pages 1-21, March.
    16. Shemendyuk, Aleksandr & Wagner, Joël, 2024. "On the factors determining the health profiles and care needs of institutionalized elders," Insurance: Mathematics and Economics, Elsevier, vol. 114(C), pages 223-241.
    17. Brito, M.R. & Quiroz, A.J. & Yukich, J.E., 2013. "Intrinsic dimension identification via graph-theoretic methods," Journal of Multivariate Analysis, Elsevier, vol. 116(C), pages 263-277.
    18. Alaa Tharwat & Aboul Ella Hassanien, 2019. "Quantum-Behaved Particle Swarm Optimization for Parameter Optimization of Support Vector Machine," Journal of Classification, Springer;The Classification Society, vol. 36(3), pages 576-598, October.
    19. Emily S W Wong & Margaret C Hardy & David Wood & Timothy Bailey & Glenn F King, 2013. "SVM-Based Prediction of Propeptide Cleavage Sites in Spider Toxins Identifies Toxin Innovation in an Australian Tarantula," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-11, July.
    20. Lior Shamir & John D Delaney & Nikita Orlov & D Mark Eckley & Ilya G Goldberg, 2010. "Pattern Recognition Software and Techniques for Biological Image Analysis," PLOS Computational Biology, Public Library of Science, vol. 6(11), pages 1-10, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:235:y:2015:i:1:p:85-101:10.1007/s10479-015-1956-8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.