IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v96y2020ics0305048319308448.html
   My bibliography  Save this article

Ensemble ranking: Aggregation of rankings produced by different multi-criteria decision-making methods

Author

Listed:
  • Mohammadi, Majid
  • Rezaei, Jafar

Abstract

One of the essential problems in multi-criteria decision-making (MCDM) is ranking a set of alternatives based on a set of criteria. In this regard, there exist several MCDM methods which rank the alternatives in different ways. As such, it would be worthwhile to try and arrive at a consensus on this important subject. In this paper, a new approach is proposed based on the half-quadratic (HQ) theory. The proposed approach determines an optimal weight for each of the MCDM ranking methods, which are used to compute the aggregated final ranking. The weight of each ranking method is obtained via a minimizer function that is inspired by the HQ theory, which automatically fulfills the basic constraints of weights in MCDM. The proposed framework also provides a consensus index and a trust level for the aggregated ranking. To illustrate the proposed approach, the evaluation and comparison of ontology alignment systems are modeled as an MCDM problem and the proposed framework is applied to the ontology alignment evaluation initiative (OAEI) 2018, for which the ranking of participating systems is of the utmost importance.

Suggested Citation

  • Mohammadi, Majid & Rezaei, Jafar, 2020. "Ensemble ranking: Aggregation of rankings produced by different multi-criteria decision-making methods," Omega, Elsevier, vol. 96(C).
    • Handle: RePEc:eee:jomega:v:96:y:2020:i:c:s0305048319308448
    DOI: 10.1016/j.omega.2020.102254
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048319308448
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.omega.2020.102254?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Du, Yuxian & Gao, Cai & Hu, Yong & Mahadevan, Sankaran & Deng, Yong, 2014. "A new method of identifying influential nodes in complex networks based on TOPSIS," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 399(C), pages 57-69.
    2. Peng, Yi & Kou, Gang & Wang, Guoxun & Shi, Yong, 2011. "FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms," Omega, Elsevier, vol. 39(6), pages 677-689, December.
    3. Edwards, Ward & Barron, F. Hutton, 1994. "SMARTS and SMARTER: Improved Simple Methods for Multiattribute Utility Measurement," Organizational Behavior and Human Decision Processes, Elsevier, vol. 60(3), pages 306-325, December.
    4. Banu Soylu, 2010. "Integrating Prometheeii With The Tchebycheff Function For Multi Criteria Decision Making," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 9(04), pages 525-545.
    5. Govindan, Kannan & Kadziński, Miłosz & Sivakumar, R., 2017. "Application of a novel PROMETHEE-based method for construction of a group compromise ranking to prioritization of green suppliers in food supply chain," Omega, Elsevier, vol. 71(C), pages 129-145.
    6. Gang Kou & Yanqun Lu & Yi Peng & Yong Shi, 2012. "Evaluation Of Classification Algorithms Using Mcdm And Rank Correlation," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 11(01), pages 197-225.
    7. Shojaei, Payam & Seyed Haeri, Seyed Amin & Mohammadi, Sahar, 2018. "Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique," Journal of Air Transport Management, Elsevier, vol. 68(C), pages 4-13.
    8. Opricovic, Serafim & Tzeng, Gwo-Hshiung, 2004. "Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS," European Journal of Operational Research, Elsevier, vol. 156(2), pages 445-455, July.
    9. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Juin-Hao Ho & Gwo-Guang Lee & Ming-Tsang Lu, 2020. "Exploring the Implementation of a Legal AI Bot for Sustainable Development in Legal Advisory Institutions," Sustainability, MDPI, vol. 12(15), pages 1-17, July.
    2. Ridha, Hussein Mohammed & Gomes, Chandima & Hizam, Hashim & Ahmadipour, Masoud & Heidari, Ali Asghar & Chen, Huiling, 2021. "Multi-objective optimization and multi-criteria decision-making methods for optimal design of standalone photovoltaic system: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    3. Amin Mahmoudi & Saad Ahmed Javed, 2022. "Probabilistic Approach to Multi-Stage Supplier Evaluation: Confidence Level Measurement in Ordinal Priority Approach," Group Decision and Negotiation, Springer, vol. 31(5), pages 1051-1096, October.
    4. Meng, Fanyong & Tang, Jie & An, Qingxian, 2023. "Cooperative game based two-stage consensus adjustment mechanism for large-scale group decision making," Omega, Elsevier, vol. 117(C).
    5. Feng, Jianghong & Xu, Su Xiu & Xu, Gangyan & Cheng, Huibing, 2022. "An integrated decision-making method for locating parking centers of recyclable waste transportation vehicles," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 157(C).
    6. Akbari, Sina & Escobedo, Adolfo R., 2023. "Beyond kemeny rank aggregation: A parameterizable-penalty framework for robust ranking aggregation with ties," Omega, Elsevier, vol. 119(C).
    7. Fu, Yelin & Lu, Yihe & Yu, Chen & Lai, Kin Keung, 2022. "Inter-country comparisons of energy system performance with the energy trilemma index: An ensemble ranking methodology based on the half-quadratic theory," Energy, Elsevier, vol. 261(PA).
    8. Jalil Heidary Dahooie & Ali Husseinzadeh Kashan & Zahra Shoaei Naeini & Amir Salar Vanaki & Edmundas Kazimieras Zavadskas & Zenonas Turskis, 2022. "A Hybrid Multi-Criteria-Decision-Making Aggregation Method and Geographic Information System for Selecting Optimal Solar Power Plants in Iran," Energies, MDPI, vol. 15(8), pages 1-20, April.
    9. Wang, Qun & Jia, Guozhu & Song, Wenyan, 2022. "Identifying critical factors in systems with interrelated components: A method considering heterogeneous influence and strength attenuation," European Journal of Operational Research, Elsevier, vol. 303(1), pages 456-470.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zheng Yuan & Baohua Wen & Cheng He & Jin Zhou & Zhonghua Zhou & Feng Xu, 2022. "Application of Multi-Criteria Decision-Making Analysis to Rural Spatial Sustainability Evaluation: A Systematic Review," IJERPH, MDPI, vol. 19(11), pages 1-31, May.
    2. Thomas L. Saaty & Daji Ergu, 2015. "When is a Decision-Making Method Trustworthy? Criteria for Evaluating Multi-Criteria Decision-Making Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 14(06), pages 1171-1187, November.
    3. Eduardo Fernandez & Jorge Navarro & Rafael Olmedo, 2018. "Characterization of the Effectiveness of Several Outranking-Based Multi-Criteria Sorting Methods," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(04), pages 1047-1084, July.
    4. Mi, Xiaomei & Tang, Ming & Liao, Huchang & Shen, Wenjing & Lev, Benjamin, 2019. "The state-of-the-art survey on integrations and applications of the best worst method in decision making: Why, what, what for and what's next?," Omega, Elsevier, vol. 87(C), pages 205-225.
    5. Huseyin Kocak & Atalay Caglar & Gulin Zeynep Oztas, 2018. "Euclidean Best–Worst Method and Its Application," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(05), pages 1587-1605, September.
    6. Morteza Yazdani & Dragan Pamucar & Prasenjit Chatterjee & Ali Ebadi Torkayesh, 2022. "“A multi-tier sustainable food supplier selection model under uncertainty”," Operations Management Research, Springer, vol. 15(1), pages 116-145, June.
    7. Yi Peng, 2015. "Regional earthquake vulnerability assessment using a combination of MCDM methods," Annals of Operations Research, Springer, vol. 234(1), pages 95-110, November.
    8. Kuang-Hua Hu & Wei Jianguo & Gwo-Hshiung Tzeng, 2017. "Risk Factor Assessment Improvement for China’s Cloud Computing Auditing Using a New Hybrid MADM Model," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 16(03), pages 737-777, May.
    9. Maghsoodi, Abtin Ijadi, 2023. "Cryptocurrency portfolio allocation using a novel hybrid and predictive big data decision support system," Omega, Elsevier, vol. 115(C).
    10. Hisham Alidrisi, 2021. "An Innovative Job Evaluation Approach Using the VIKOR Algorithm," JRFM, MDPI, vol. 14(6), pages 1-19, June.
    11. Ioannis Sitaridis & Fotis Kitsios, 2020. "Competitiveness analysis and evaluation of entrepreneurial ecosystems: a multi-criteria approach," Annals of Operations Research, Springer, vol. 294(1), pages 377-399, November.
    12. Jing Wang & Jian-Qiang Wang & Hong-Yu Zhang & Xiao-Hong Chen, 2017. "Distance-Based Multi-Criteria Group Decision-Making Approaches with Multi-Hesitant Fuzzy Linguistic Information," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 16(04), pages 1069-1099, July.
    13. Bartłomiej Kizielewicz & Jarosław Wątróbski & Wojciech Sałabun, 2020. "Identification of Relevant Criteria Set in the MCDA Process—Wind Farm Location Case Study," Energies, MDPI, vol. 13(24), pages 1-40, December.
    14. Lei Wang & Qing Liu & Tongle Yin, 2018. "Decision-making of investment in navigation safety improving schemes with application of cumulative prospect theory," Journal of Risk and Reliability, , vol. 232(6), pages 710-724, December.
    15. Wenshuai Wu & Yi Peng, 2016. "Extension of grey relational analysis for facilitating group consensus to oil spill emergency management," Annals of Operations Research, Springer, vol. 238(1), pages 615-635, March.
    16. Wenshuai Wu & Yi Peng, 2016. "Extension of grey relational analysis for facilitating group consensus to oil spill emergency management," Annals of Operations Research, Springer, vol. 238(1), pages 615-635, March.
    17. Roman Vavrek, 2019. "Evaluation of the Impact of Selected Weighting Methods on the Results of the TOPSIS Technique," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(06), pages 1821-1843, November.
    18. Abderahman Rejeb & Karim Rejeb & John G. Keogh & Suhaiza Zailani, 2022. "Barriers to Blockchain Adoption in the Circular Economy: A Fuzzy Delphi and Best-Worst Approach," Sustainability, MDPI, vol. 14(6), pages 1-23, March.
    19. Kai Wang & Zhe Wang & Jun Deng & Yuanyuan Feng & Quanfang Li, 2022. "Study on the Evaluation of Emergency Management Capacity of Resilient Communities by the AHP-TOPSIS Method," IJERPH, MDPI, vol. 19(23), pages 1-14, December.
    20. Ridha, Hussein Mohammed & Gomes, Chandima & Hizam, Hashim & Ahmadipour, Masoud & Heidari, Ali Asghar & Chen, Huiling, 2021. "Multi-objective optimization and multi-criteria decision-making methods for optimal design of standalone photovoltaic system: A comprehensive review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:96:y:2020:i:c:s0305048319308448. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.