IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v316y2024i1p46-60.html

A distributionally robust chance-constrained kernel-free quadratic surface support vector machine

Author

Listed:
  • Lin, Fengming
  • Fang, Shu-Cherng
  • Fang, Xiaolei
  • Gao, Zheming
  • Luo, Jian

Abstract

This paper studies the problem of constructing a robust nonlinear classifier when the data set involves uncertainty and only the first- and second-order moments are known a priori. A distributionally robust chance-constrained kernel-free quadratic surface support vector machine (SVM) model is proposed using the moment information of the uncertain data. The proposed model is reformulated as a semidefinite programming problem and a second-order cone programming problem for efficient computations. A geometric interpretation of the proposed model is also provided. For commonly used data without prescribed uncertainty, a cluster-based data-driven approach is introduced to retrieve the hidden moment information that enables the proposed model for robust classification. Extensive computational experiments using synthetic and public benchmark data sets with or without uncertainty involved support the superior performance of the proposed model over other state-of-the-art SVM models, particularly when the data sets are massive and/or imbalanced.

Suggested Citation

  • Lin, Fengming & Fang, Shu-Cherng & Fang, Xiaolei & Gao, Zheming & Luo, Jian, 2024. "A distributionally robust chance-constrained kernel-free quadratic surface support vector machine," European Journal of Operational Research, Elsevier, vol. 316(1), pages 46-60.
  • Handle: RePEc:eee:ejores:v:316:y:2024:i:1:p:46-60
    DOI: 10.1016/j.ejor.2024.02.022
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221724001309
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2024.02.022?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Mi, Yunlong & Quan, Pei & Shi, Yong & Wang, Zongrun, 2022. "Concept-cognitive computing system for dynamic classification," European Journal of Operational Research, Elsevier, vol. 301(1), pages 287-299.
    2. Trafalis, Theodore B. & Gilbert, Robin C., 2006. "Robust classification and regression using support vector machines," European Journal of Operational Research, Elsevier, vol. 173(3), pages 893-909, September.
    3. Jiménez-Cordero, Asunción & Morales, Juan Miguel & Pineda, Salvador, 2021. "A novel embedded min-max approach for feature selection in nonlinear Support Vector Machine classification," European Journal of Operational Research, Elsevier, vol. 293(1), pages 24-35.
    4. Gao, Zheming & Fang, Shu-Cherng & Luo, Jian & Medhin, Negash, 2021. "A kernel-free double well potential support vector machine with applications," European Journal of Operational Research, Elsevier, vol. 290(1), pages 248-262.
    5. Naumzik, Christof & Feuerriegel, Stefan & Nielsen, Anne Molgaard, 2023. "Data-driven dynamic treatment planning for chronic diseases," European Journal of Operational Research, Elsevier, vol. 305(2), pages 853-867.
    6. Neda Abdelhamid & Arun Padmavathy & David Peebles & Fadi Thabtah & Daymond Goulder-Horobin, 2020. "Data Imbalance in Autism Pre-Diagnosis Classification Systems: An Experimental Study," Journal of Information & Knowledge Management (JIKM), World Scientific Publishing Co. Pte. Ltd., vol. 19(01), pages 1-16, March.
    7. Jian Luo & Shu-Cherng Fang & Zhibin Deng & Xiaoling Guo, 2016. "Soft Quadratic Surface Support Vector Machine for Binary Classification," Asia-Pacific Journal of Operational Research (APJOR), World Scientific Publishing Co. Pte. Ltd., vol. 33(06), pages 1-22, December.
    8. Erick Delage & Yinyu Ye, 2010. "Distributionally Robust Optimization Under Moment Uncertainty with Application to Data-Driven Problems," Operations Research, INFORMS, vol. 58(3), pages 595-612, June.
    9. Ximing Wang & Neng Fan & Panos M. Pardalos, 2018. "Robust chance-constrained support vector machines with second-order moment information," Annals of Operations Research, Springer, vol. 263(1), pages 45-68, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maggioni, Francesca & Spinelli, Andrea, 2025. "A novel robust optimization model for nonlinear Support Vector Machine," European Journal of Operational Research, Elsevier, vol. 322(1), pages 237-253.
    2. Carrizosa, Emilio & Halskov, Thomas & Romero Morales, Dolores, 2026. "Wasserstein support vector machine: Support vector machines made fair," European Journal of Operational Research, Elsevier, vol. 329(2), pages 641-652.
    3. Jiguang Wang & Fangfang Guo & Jie Shen, 2025. "An $$L_2$$ L 2 regularization reduced quadratic surface support vector machine model," Journal of Combinatorial Optimization, Springer, vol. 49(2), pages 1-28, March.
    4. Luo, Zunhao & Wang, Dujuan & Yin, Yunqiang & Ignatius, Joshua & Cheng, T.C.E., 2025. "Service composition and optimal selection in cloud manufacturing under event-dependent distributional uncertainty of manufacturing capabilities," European Journal of Operational Research, Elsevier, vol. 325(2), pages 281-302.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Maggioni, Francesca & Spinelli, Andrea, 2025. "A novel robust optimization model for nonlinear Support Vector Machine," European Journal of Operational Research, Elsevier, vol. 322(1), pages 237-253.
    2. Andrew J. Keith & Darryl K. Ahner, 2021. "A survey of decision making and optimization under uncertainty," Annals of Operations Research, Springer, vol. 300(2), pages 319-353, May.
    3. Mingyang Wu & Zhixia Yang, 2025. "Kernel-free Reduced Quadratic Surface Support Vector Machine with 0-1 Loss Function and L $$_p$$ p -norm Regularization," Annals of Data Science, Springer, vol. 12(1), pages 381-412, February.
    4. Zhi Chen & Melvyn Sim & Huan Xu, 2019. "Distributionally Robust Optimization with Infinitely Constrained Ambiguity Sets," Operations Research, INFORMS, vol. 67(5), pages 1328-1344, September.
    5. Rupendra Yadav & Aparna Mehra, 2025. "Robust MCVaR Portfolio Optimization with Ellipsoidal Support and Reproducing Kernel Hilbert Space-based Uncertainty," Papers 2509.00447, arXiv.org.
    6. Jun-ya Gotoh & Michael Jong Kim & Andrew E. B. Lim, 2020. "Worst-case sensitivity," Papers 2010.10794, arXiv.org.
    7. Zhang, Hanxiao & Li, Yan-Fu, 2022. "Robust optimization on redundancy allocation problems in multi-state and continuous-state series–parallel systems," Reliability Engineering and System Safety, Elsevier, vol. 218(PA).
    8. Mika Meitz, 2024. "Statistical inference for generative adversarial networks and other minimax problems," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 51(3), pages 1323-1356, September.
    9. Long He & Nan Ke & Ruijiu Mao & Wei Qi & Hongcai Zhang, 2024. "From Curtailed Renewable Energy to Green Hydrogen: Infrastructure Planning for Hydrogen Fuel-Cell Vehicles," Manufacturing & Service Operations Management, INFORMS, vol. 26(5), pages 1750-1767, September.
    10. Zhang, Mengling & Ran, Lun & Leng, Jianzhi, 2026. "Optimal self-scheduling and market involvement with electricity price uncertainty," Omega, Elsevier, vol. 138(C).
    11. Soonhui Lee & Tito Homem-de-Mello & Anton Kleywegt, 2012. "Newsvendor-type models with decision-dependent uncertainty," Mathematical Methods of Operations Research, Springer;Gesellschaft für Operations Research (GOR);Nederlands Genootschap voor Besliskunde (NGB), vol. 76(2), pages 189-221, October.
    12. Gu, Bo & Li, Fangxing & Mao, Chengxiong & Wang, Dan & Fan, Hua & Liu, Bin & Li, Wenhao, 2025. "A Bilevel robust coordination model for community integrated energy system with access to HFCEVs and EVs," Applied Energy, Elsevier, vol. 390(C).
    13. Jose Blanchet & Henry Lam & Yang Liu & Ruodu Wang, 2025. "Convolution Bounds on Quantile Aggregation," Operations Research, INFORMS, vol. 73(5), pages 2761-2781, September.
    14. Ruiwei Jiang & Siqian Shen & Yiling Zhang, 2017. "Integer Programming Approaches for Appointment Scheduling with Random No-Shows and Service Durations," Operations Research, INFORMS, vol. 65(6), pages 1638-1656, December.
    15. Gong, Hailei & Zhang, Zhi-Hai, 2022. "Benders decomposition for the distributionally robust optimization of pricing and reverse logistics network design in remanufacturing systems," European Journal of Operational Research, Elsevier, vol. 297(2), pages 496-510.
    16. M. A. Lejeune & H. N. Nguyen, 2026. "Distributionally robust fractional optimization of probability of exceedance," Journal of Global Optimization, Springer, vol. 94(1), pages 127-174, January.
    17. Jun‐ya Gotoh & Michael Jong Kim & Andrew E. B. Lim, 2021. "Calibration of Distributionally Robust Empirical Optimization Models," Operations Research, INFORMS, vol. 69(5), pages 1630-1650, September.
    18. Borgonovo, Emanuele & Plischke, Elmar & Rabitti, Giovanni, 2024. "The many Shapley values for explainable artificial intelligence: A sensitivity analysis perspective," European Journal of Operational Research, Elsevier, vol. 318(3), pages 911-926.
    19. Viet Anh Nguyen & Fan Zhang & Shanshan Wang & Jose Blanchet & Erick Delage & Yinyu Ye, 2021. "Robustifying Conditional Portfolio Decisions via Optimal Transport," Papers 2103.16451, arXiv.org, revised Apr 2024.
    20. Viet Anh Nguyen & Daniel Kuhn & Peyman Mohajerin Esfahani, 2018. "Distributionally Robust Inverse Covariance Estimation: The Wasserstein Shrinkage Estimator," Papers 1805.07194, arXiv.org.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:316:y:2024:i:1:p:46-60. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.