IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v325y2023i2d10.1007_s10479-022-04986-9.html
   My bibliography  Save this article

Multi-criteria classification, sorting, and clustering: a bibliometric review and research agenda

Author

Listed:
  • Sarah Ben Amor

    (University of Ottawa)

  • Fateh Belaid

    (Lille Catholic University)

  • Ramzi Benkraiem

    (Audencia Business School (AACSB, EQUIS & AMBA))

  • Boumediene Ramdani

    (Qatar University)

  • Khaled Guesmi

    (Paris School of Business)

Abstract

Multi-criteria decision analysis (MCDA) has been increasingly adopted to solve decision-making problems involving multiple options and multiple criteria. These methods have been proven to improve the analytic rigor, transparency, and auditability of the decision-making process by integrating the performance of options in different criteria and balancing subjective preferences from different stakeholders. This review aims to map the academic research on multi-criteria sorting, classification and clustering methods, and highlights the key research trends and avenues by conducting a bibliometric analysis. We contribute to the body of knowledge in multi-criteria decision analysis in four ways: (1) identifying the most influential articles on this topic, (2) mapping the research on multi-criteria sorting, classification and clustering methods, (3) visualizing the trends in this field of research through network analysis, and (4) highlighting areas for future research. The results of this study help academics and practitioners to navigate the literature on MCDA methods, provide a map of existing evidence, and recommend promising avenues for future research.

Suggested Citation

  • Sarah Ben Amor & Fateh Belaid & Ramzi Benkraiem & Boumediene Ramdani & Khaled Guesmi, 2023. "Multi-criteria classification, sorting, and clustering: a bibliometric review and research agenda," Annals of Operations Research, Springer, vol. 325(2), pages 771-793, June.
    • Handle: RePEc:spr:annopr:v:325:y:2023:i:2:d:10.1007_s10479-022-04986-9
    DOI: 10.1007/s10479-022-04986-9
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-022-04986-9
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-022-04986-9?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bouzayane, Sarra & Saad, Inès, 2020. "A multicriteria approach based on rough set theory for the incremental Periodic prediction," European Journal of Operational Research, Elsevier, vol. 286(1), pages 282-298.
    2. Danvila-del-Valle, Ignacio & Estévez-Mendoza, Carlos & Lara, Francisco J., 2019. "Human resources training: A bibliometric analysis," Journal of Business Research, Elsevier, vol. 101(C), pages 627-636.
    3. Aria, Massimo & Cuccurullo, Corrado, 2017. "bibliometrix: An R-tool for comprehensive science mapping analysis," Journal of Informetrics, Elsevier, vol. 11(4), pages 959-975.
    4. Hatami-Marbini, Adel & Tavana, Madjid, 2011. "An extension of the Electre I method for group decision-making under a fuzzy environment," Omega, Elsevier, vol. 39(4), pages 373-386, August.
    5. Wang, Jiang-Jiang & Jing, You-Yin & Zhang, Chun-Fa & Zhao, Jun-Hong, 2009. "Review on multi-criteria decision analysis aid in sustainable energy decision-making," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(9), pages 2263-2278, December.
    6. Miłosz Kadziński & Salvatore Greco & Roman Słowiński, 2013. "Selection of a Representative Value Function for Robust Ordinal Regression in Group Decision Making," Group Decision and Negotiation, Springer, vol. 22(3), pages 429-462, May.
    7. Thomas L. Saaty, 1986. "Axiomatic Foundation of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 32(7), pages 841-855, July.
    8. Vusal Babashov & Sarah Ben Amor & Gilles Reinhardt, 2020. "Framework for Drug Formulary Decision Using Multiple-Criteria Decision Analysis," Medical Decision Making, , vol. 40(4), pages 438-447, May.
    9. Zopounidis, Constantin & Doumpos, Michael, 2002. "Multicriteria classification and sorting methods: A literature review," European Journal of Operational Research, Elsevier, vol. 138(2), pages 229-246, April.
    10. Bouyssou, Denis, 1986. "Some remarks on the notion of compensation in MCDM," European Journal of Operational Research, Elsevier, vol. 26(1), pages 150-160, July.
    11. Gang Kou & Yanqun Lu & Yi Peng & Yong Shi, 2012. "Evaluation Of Classification Algorithms Using Mcdm And Rank Correlation," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 11(01), pages 197-225.
    12. Henry Small, 1973. "Co‐citation in the scientific literature: A new measure of the relationship between two documents," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 24(4), pages 265-269, July.
    13. Belacel, Nabil, 2000. "Multicriteria assignment method PROAFTN: Methodology and medical application," European Journal of Operational Research, Elsevier, vol. 125(1), pages 175-183, August.
    14. Almeida-Dias, J. & Figueira, J.R. & Roy, B., 2012. "A multiple criteria sorting method where each category is characterized by several reference actions: The Electre Tri-nC method," European Journal of Operational Research, Elsevier, vol. 217(3), pages 567-579.
    15. Kadziński, Miłosz & Greco, Salvatore & Słowiński, Roman, 2012. "Selection of a representative value function in robust multiple criteria ranking and choice," European Journal of Operational Research, Elsevier, vol. 217(3), pages 541-553.
    16. Atici, Kazim Baris & Simsek, Ahmet Bahadir & Ulucan, Aydin & Tosun, Mustafa Umur, 2015. "A GIS-based Multiple Criteria Decision Analysis approach for wind power plant site selection," Utilities Policy, Elsevier, vol. 37(C), pages 86-96.
    17. Durbach, Ian N. & Stewart, Theodor J., 2012. "Modeling uncertainty in multi-criteria decision analysis," European Journal of Operational Research, Elsevier, vol. 223(1), pages 1-14.
    18. Hannan Amoozad Mahdiraji & Edmundas Kazimieras Zavadskas & Aliakbar Kazeminia & AliAsghar Abbasi Kamardi, 2019. "Marketing strategies evaluation based on big data analysis: a CLUSTERING-MCDM approach," Economic Research-Ekonomska Istraživanja, Taylor & Francis Journals, vol. 32(1), pages 2882-2898, January.
    19. Costa, Ana Sara & Corrente, Salvatore & Greco, Salvatore & Figueira, José Rui & Borbinha, José, 2020. "A robust hierarchical nominal multicriteria classification method based on similarity and dissimilarity," European Journal of Operational Research, Elsevier, vol. 286(3), pages 986-1001.
    20. Constantin Zopounidis & Emilios C. C Galariotis & Michael Doumpos & Stavroula Sarri & Kostas Andriosopoulos, 2015. "Multiple criteria decision aiding for finance: An updated bibliographic survey," Post-Print hal-02879842, HAL.
    21. Saaty, Thomas L., 1990. "How to make a decision: The analytic hierarchy process," European Journal of Operational Research, Elsevier, vol. 48(1), pages 9-26, September.
    22. Sarrazin, R. & De Smet, Y. & Rosenfeld, J., 2018. "An extension of PROMETHEE to interval clustering," Omega, Elsevier, vol. 80(C), pages 12-21.
    23. Doumpos, Michael & Zopounidis, Constantin, 2011. "Preference disaggregation and statistical learning for multicriteria decision support: A review," European Journal of Operational Research, Elsevier, vol. 209(3), pages 203-214, March.
    24. Salvatore Corrente & Michael Doumpos & Salvatore Greco & Roman Słowiński & Constantin Zopounidis, 2017. "Multiple criteria hierarchy process for sorting problems based on ordinal regression with additive value functions," Annals of Operations Research, Springer, vol. 251(1), pages 117-139, April.
    25. Blaszczynski, Jerzy & Greco, Salvatore & Slowinski, Roman, 2007. "Multi-criteria classification - A new scheme for application of dominance-based decision rules," European Journal of Operational Research, Elsevier, vol. 181(3), pages 1030-1044, September.
    26. Peng, Yi & Kou, Gang & Wang, Guoxun & Shi, Yong, 2011. "FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms," Omega, Elsevier, vol. 39(6), pages 677-689, December.
    27. Pawlak, Zdzisaw & Sowinski, Roman, 1994. "Rough set approach to multi-attribute decision analysis," European Journal of Operational Research, Elsevier, vol. 72(3), pages 443-459, February.
    28. Greco, Salvatore & Matarazzo, Benedetto & Slowinski, Roman, 2001. "Rough sets theory for multicriteria decision analysis," European Journal of Operational Research, Elsevier, vol. 129(1), pages 1-47, February.
    29. Angilella, Silvia & Mazzù, Sebastiano, 2015. "The financing of innovative SMEs: A multicriteria credit rating model," European Journal of Operational Research, Elsevier, vol. 244(2), pages 540-554.
    30. Almeida-Dias, J. & Figueira, J.R. & Roy, B., 2010. "Electre Tri-C: A multiple criteria sorting method based on characteristic reference actions," European Journal of Operational Research, Elsevier, vol. 204(3), pages 565-580, August.
    31. J. P. Brans & Ph. Vincke, 1985. "Note---A Preference Ranking Organisation Method," Management Science, INFORMS, vol. 31(6), pages 647-656, June.
    32. James Dolan, 2010. "Multi-Criteria Clinical Decision Support," The Patient: Patient-Centered Outcomes Research, Springer;International Academy of Health Preference Research, vol. 3(4), pages 229-248, December.
    33. Greco, Salvatore & Matarazzo, Benedetto & Slowinski, Roman, 1999. "Rough approximation of a preference relation by dominance relations," European Journal of Operational Research, Elsevier, vol. 117(1), pages 63-83, August.
    34. Mohammad Ebrahim Banihabib & Mahmoud Mohammad Rezapour Tabari & Mohsen Mohammad Rezapour Tabari, 2019. "Development of a Fuzzy Multi-Objective Heuristic Model for Optimum Water Allocation," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(11), pages 3673-3689, September.
    35. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2021. "Robust stochastic sorting with interacting criteria hierarchically structured," European Journal of Operational Research, Elsevier, vol. 292(2), pages 735-754.
    36. Pawlak, Zdzislaw, 1997. "Rough set approach to knowledge-based decision support," European Journal of Operational Research, Elsevier, vol. 99(1), pages 48-57, May.
    37. Liu, Jiapeng & Liao, Xiuwu & Kadziński, Miłosz & Słowiński, Roman, 2019. "Preference disaggregation within the regularization framework for sorting problems with multiple potentially non-monotonic criteria," European Journal of Operational Research, Elsevier, vol. 276(3), pages 1071-1089.
    38. Ananda, Jayanath & Herath, Gamini, 2009. "A critical review of multi-criteria decision making methods with special reference to forest management and planning," Ecological Economics, Elsevier, vol. 68(10), pages 2535-2548, August.
    39. Mousseau, Vincent & Figueira, Jose & Dias, Luis & Gomes da Silva, Carlos & Climaco, Joao, 2003. "Resolving inconsistencies among constraints on the parameters of an MCDA model," European Journal of Operational Research, Elsevier, vol. 147(1), pages 72-93, May.
    40. Figueira, Jose & Roy, Bernard, 2002. "Determining the weights of criteria in the ELECTRE type methods with a revised Simos' procedure," European Journal of Operational Research, Elsevier, vol. 139(2), pages 317-326, June.
    41. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    42. Boujelben, Mohamed Ayman, 2017. "A unicriterion analysis based on the PROMETHEE principles for multicriteria ordered clustering," Omega, Elsevier, vol. 69(C), pages 126-140.
    43. De Smet, Yves & Montano Guzman, Linett, 2004. "Towards multicriteria clustering: An extension of the k-means algorithm," European Journal of Operational Research, Elsevier, vol. 158(2), pages 390-398, October.
    44. Valentinas Podvezko, 2009. "Application of AHP technique," Journal of Business Economics and Management, Taylor & Francis Journals, vol. 10(2), pages 181-189, March.
    45. Sánchez-Lozano, Juan M. & Henggeler Antunes, Carlos & García-Cascales, M. Socorro & Dias, Luis C., 2014. "GIS-based photovoltaic solar farms site selection using ELECTRE-TRI: Evaluating the case for Torre Pacheco, Murcia, Southeast of Spain," Renewable Energy, Elsevier, vol. 66(C), pages 478-494.
    46. Pelissari, Renata & Oliveira, Maria Célia & Ben Amor, Sarah & Abackerli, Alvaro José, 2019. "A new FlowSort-based method to deal with information imperfections in sorting decision-making problems," European Journal of Operational Research, Elsevier, vol. 276(1), pages 235-246.
    47. Howard D. White & Belver C. Griffith, 1981. "Author cocitation: A literature measure of intellectual structure," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 32(3), pages 163-171, May.
    48. Xu, Chuanbo & Wu, Yunna & Dai, Shuyu, 2020. "What are the critical barriers to the development of hydrogen refueling stations in China? A modified fuzzy DEMATEL approach," Energy Policy, Elsevier, vol. 142(C).
    49. Greco, Salvatore & Matarazzo, Benedetto & Slowinski, Roman, 2002. "Rough sets methodology for sorting problems in presence of multiple attributes and criteria," European Journal of Operational Research, Elsevier, vol. 138(2), pages 247-259, April.
    50. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2021. "The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method," European Journal of Operational Research, Elsevier, vol. 288(1), pages 225-246.
    51. Fernandez, Eduardo & Navarro, Jorge & Duarte, Alfonso, 2008. "Multicriteria sorting using a valued preference closeness relation," European Journal of Operational Research, Elsevier, vol. 185(2), pages 673-686, March.
    52. Meyer, Patrick & Olteanu, Alexandru-Liviu, 2013. "Formalizing and solving the problem of clustering in MCDA," European Journal of Operational Research, Elsevier, vol. 227(3), pages 494-502.
    53. Michael Doumpos & Chrysovalantis Gaganis & Fotios Pasiouras, 2016. "Bank Diversification and Overall Financial Strength: International Evidence," Working Papers 1602, University of Crete, Department of Economics.
    54. Ghaderi, Mohammad & Ruiz, Francisco & Agell, Núria, 2017. "A linear programming approach for learning non-monotonic additive value functions in multiple criteria decision aiding," European Journal of Operational Research, Elsevier, vol. 259(3), pages 1073-1084.
    55. Salvatore Greco & Alessio Ishizaka & Benedetto Matarazzo & Gianpiero Torrisi, 2018. "Stochastic multi-attribute acceptability analysis (SMAA): an application to the ranking of Italian regions," Regional Studies, Taylor & Francis Journals, vol. 52(4), pages 585-600, April.
    56. Constantin Zopounidis & Emilios Galariotis & Michael Doumpos & Stavroula Sarri & Kostas Andriosopoulos, 2015. "Multiple criteria decision aiding for finance: An updated bibliographic survey," Post-Print hal-01183389, HAL.
    57. Steuer, Ralph E. & Na, Paul, 2003. "Multiple criteria decision making combined with finance: A categorized bibliographic study," European Journal of Operational Research, Elsevier, vol. 150(3), pages 496-515, November.
    58. Bernard Roy, 2010. "Two conceptions of decision aiding," International Journal of Multicriteria Decision Making, Inderscience Enterprises Ltd, vol. 1(1), pages 74-79.
    59. Grabisch, Michel, 1996. "The application of fuzzy integrals in multicriteria decision making," European Journal of Operational Research, Elsevier, vol. 89(3), pages 445-456, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Govindan, Kannan & Jepsen, Martin Brandt, 2016. "ELECTRE: A comprehensive literature review on methodologies and applications," European Journal of Operational Research, Elsevier, vol. 250(1), pages 1-29.
    2. Khaled Belahcène & Vincent Mousseau & Wassila Ouerdane & Marc Pirlot & Olivier Sobrie, 2023. "Multiple criteria sorting models and methods—Part I: survey of the literature," 4OR, Springer, vol. 21(1), pages 1-46, March.
    3. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2021. "Robust stochastic sorting with interacting criteria hierarchically structured," European Journal of Operational Research, Elsevier, vol. 292(2), pages 735-754.
    4. Chrysovalantis Gaganis & Panagiota Papadimitri & Menelaos Tasiou, 2021. "A multicriteria decision support tool for modelling bank credit ratings," Annals of Operations Research, Springer, vol. 306(1), pages 27-56, November.
    5. Tlili, Ali & Belahcène, Khaled & Khaled, Oumaima & Mousseau, Vincent & Ouerdane, Wassila, 2022. "Learning non-compensatory sorting models using efficient SAT/MaxSAT formulations," European Journal of Operational Research, Elsevier, vol. 298(3), pages 979-1006.
    6. Ishizaka, Alessio & Lokman, Banu & Tasiou, Menelaos, 2021. "A Stochastic Multi-criteria divisive hierarchical clustering algorithm," Omega, Elsevier, vol. 103(C).
    7. Liu, Jiapeng & Kadziński, Miłosz & Liao, Xiuwu & Mao, Xiaoxin & Wang, Yao, 2020. "A preference learning framework for multiple criteria sorting with diverse additive value models and valued assignment examples," European Journal of Operational Research, Elsevier, vol. 286(3), pages 963-985.
    8. Renaud, J. & Thibault, J. & Lanouette, R. & Kiss, L.N. & Zaras, K. & Fonteix, C., 2007. "Comparison of two multicriteria decision aid methods: Net Flow and Rough Set Methods in a high yield pulping process," European Journal of Operational Research, Elsevier, vol. 177(3), pages 1418-1432, March.
    9. Costa, Ana Sara & Figueira, José Rui & Borbinha, José, 2018. "A multiple criteria nominal classification method based on the concepts of similarity and dissimilarity," European Journal of Operational Research, Elsevier, vol. 271(1), pages 193-209.
    10. Kadziński, Miłosz & Ghaderi, Mohammad & Dąbrowski, Maciej, 2020. "Contingent preference disaggregation model for multiple criteria sorting problem," European Journal of Operational Research, Elsevier, vol. 281(2), pages 369-387.
    11. Fernandez, Eduardo & Navarro, Jorge & Bernal, Sergio, 2009. "Multicriteria sorting using a valued indifference relation under a preference disaggregation paradigm," European Journal of Operational Research, Elsevier, vol. 198(2), pages 602-609, October.
    12. Wu, Siqi & Wu, Meng & Dong, Yucheng & Liang, Haiming & Zhao, Sihai, 2020. "The 2-rank additive model with axiomatic design in multiple attribute decision making," European Journal of Operational Research, Elsevier, vol. 287(2), pages 536-545.
    13. Zhen Zhang & Zhuolin Li, 2023. "Consensus-based TOPSIS-Sort-B for multi-criteria sorting in the context of group decision-making," Annals of Operations Research, Springer, vol. 325(2), pages 911-938, June.
    14. Cinelli, Marco & Kadziński, Miłosz & Gonzalez, Michael & Słowiński, Roman, 2020. "How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy," Omega, Elsevier, vol. 96(C).
    15. Chakhar, Salem & Ishizaka, Alessio & Thorpe, Andy & Cox, Joe & Nguyen, Thang & Ford, Liz, 2020. "Calculating the relative importance of condition attributes based on the characteristics of decision rules and attribute reducts: Application to crowdfunding," European Journal of Operational Research, Elsevier, vol. 286(2), pages 689-712.
    16. Eduardo Fernandez & Jorge Navarro & Rafael Olmedo, 2018. "Characterization of the Effectiveness of Several Outranking-Based Multi-Criteria Sorting Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1047-1084, July.
    17. Díaz, Raymundo & Fernández, Eduardo & Figueira, José-Rui & Navarro, Jorge & Solares, Efrain, 2023. "A new hierarchical multiple criteria ordered clustering approach as a complementary tool for sorting and ranking problems," Omega, Elsevier, vol. 117(C).
    18. Chakhar, Salem & Ishizaka, Alessio & Labib, Ashraf & Saad, Inès, 2016. "Dominance-based rough set approach for group decisions," European Journal of Operational Research, Elsevier, vol. 251(1), pages 206-224.
    19. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    20. Figueira, José Rui & Greco, Salvatore & Roy, Bernard, 2022. "Electre-Score: A first outranking based method for scoring actions," European Journal of Operational Research, Elsevier, vol. 297(3), pages 986-1005.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:325:y:2023:i:2:d:10.1007_s10479-022-04986-9. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.