IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v119y2023ics0305048323000579.html
   My bibliography  Save this article

Beyond kemeny rank aggregation: A parameterizable-penalty framework for robust ranking aggregation with ties

Author

Listed:
  • Akbari, Sina
  • Escobedo, Adolfo R.

Abstract

Rank Aggregation has ubiquitous applications in operations research, artificial intelligence, computational social choice, and various other fields. Interest in this problem has increased due in part to the need to consolidate lists of rankings and scores output by different decision-making processes and algorithms. Although most attention has focused on the variant of this problem induced by the Kemeny-Snell distance, other robust rank aggregation problems have been proposed. This work delves into the rank aggregation problem under the generalized Kendall-tau distance —a parameterizable-penalty distance measure for comparing rankings with ties— which contains Kemeny aggregation as a special case. First, it derives exact and heuristic solution methods. Second, it introduces a social choice property (GXCC) that encloses existing variations of the Condorcet criterion as special cases, thereby expanding this seminal social choice concept beyond Kemeny aggregation for the first time. GXCC offers both computational and theoretical advantages. In particular, GXCC may help to divide the original problem into smaller subproblems, while still ensuring that solving them independently yields the optimal solution to the original problem. Experiments on two benchmark datasets conducted herein show that the featured exact and heuristic solution methods can benefit from GXCC. Finally, this work derives new theoretical insights into the effects of the generalized Kendall-tau distance penalty parameter on the optimal ranking and on the proposed social choice property.

Suggested Citation

  • Akbari, Sina & Escobedo, Adolfo R., 2023. "Beyond kemeny rank aggregation: A parameterizable-penalty framework for robust ranking aggregation with ties," Omega, Elsevier, vol. 119(C).
  • Handle: RePEc:eee:jomega:v:119:y:2023:i:c:s0305048323000579
    DOI: 10.1016/j.omega.2023.102893
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048323000579
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2023.102893?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liao, Huchang & Wu, Xingli, 2020. "DNMA: A double normalization-based multiple aggregation method for multi-expert multi-criteria decision making," Omega, Elsevier, vol. 94(C).
    2. Yeawon Yoo & Adolfo R. Escobedo, 2021. "A New Binary Programming Formulation and Social Choice Property for Kemeny Rank Aggregation," Decision Analysis, INFORMS, vol. 18(4), pages 296-320, December.
    3. Peng, Yi & Kou, Gang & Wang, Guoxun & Shi, Yong, 2011. "FAMCDM: A fusion approach of MCDM methods to rank multiclass classification algorithms," Omega, Elsevier, vol. 39(6), pages 677-689, December.
    4. Lee, Paul H. & Yu, Philip L.H., 2010. "Distance-based tree models for ranking data," Computational Statistics & Data Analysis, Elsevier, vol. 54(6), pages 1672-1682, June.
    5. Juan A. Aledo & Jose A. Gámez & David Molina & Alejandro Rosete, 2018. "Consensus†based journal rankings: A complementary tool for bibliometric evaluation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 69(7), pages 936-948, July.
    6. Cook, Wade D., 2006. "Distance-based and ad hoc consensus models in ordinal preference ranking," European Journal of Operational Research, Elsevier, vol. 172(2), pages 369-385, July.
    7. G. Dantzig & R. Fulkerson & S. Johnson, 1954. "Solution of a Large-Scale Traveling-Salesman Problem," Operations Research, INFORMS, vol. 2(4), pages 393-410, November.
    8. Young, H. P., 1988. "Condorcet's Theory of Voting," American Political Science Review, Cambridge University Press, vol. 82(4), pages 1231-1244, December.
    9. Smith, John H, 1973. "Aggregation of Preferences with Variable Electorate," Econometrica, Econometric Society, vol. 41(6), pages 1027-1041, November.
    10. Wade D. Cook & Tal Raviv & Alan J. Richardson, 2010. "Aggregating Incomplete Lists of Journal Rankings: An Application to Academic Accounting Journals," Accounting Perspectives, John Wiley & Sons, vol. 9(3), pages 217-235, September.
    11. Young, H. P., 1977. "Extending Condorcet's rule," Journal of Economic Theory, Elsevier, vol. 16(2), pages 335-353, December.
    12. Aledo, Juan A. & Gámez, José A. & Rosete, Alejandro, 2018. "Approaching rank aggregation problems by using evolution strategies: The case of the optimal bucket order problem," European Journal of Operational Research, Elsevier, vol. 270(3), pages 982-998.
    13. Mohammadi, Majid & Rezaei, Jafar, 2020. "Ensemble ranking: Aggregation of rankings produced by different multi-criteria decision-making methods," Omega, Elsevier, vol. 96(C).
    14. Benítez-Fernández, Amalia & Ruiz, Francisco, 2020. "A Meta-Goal Programming approach to cardinal preferences aggregation in multicriteria problems," Omega, Elsevier, vol. 94(C).
    15. G. B. Dantzig & D. R. Fulkerson & S. M. Johnson, 1959. "On a Linear-Programming, Combinatorial Approach to the Traveling-Salesman Problem," Operations Research, INFORMS, vol. 7(1), pages 58-66, February.
    16. Ding, Jiankun & Han, Deqiang & Yang, Yi, 2018. "Iterative ranking aggregation using quality improvement of subgroup ranking," European Journal of Operational Research, Elsevier, vol. 268(2), pages 596-612.
    17. Erick Moreno-Centeno & Adolfo R. Escobedo, 2016. "Axiomatic aggregation of incomplete rankings," IISE Transactions, Taylor & Francis Journals, vol. 48(6), pages 475-488, June.
    18. Azzini, Ivano & Munda, Giuseppe, 2020. "A new approach for identifying the Kemeny median ranking," European Journal of Operational Research, Elsevier, vol. 281(2), pages 388-401.
    19. Antonio D’Ambrosio & Carmela Iorio & Michele Staiano & Roberta Siciliano, 2019. "Median constrained bucket order rank aggregation," Computational Statistics, Springer, vol. 34(2), pages 787-802, June.
    20. Yoo, Yeawon & Escobedo, Adolfo R. & Skolfield, J. Kyle, 2020. "A new correlation coefficient for comparing and aggregating non-strict and incomplete rankings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1025-1041.
    21. Martin Grötschel & Michael Jünger & Gerhard Reinelt, 1984. "A Cutting Plane Algorithm for the Linear Ordering Problem," Operations Research, INFORMS, vol. 32(6), pages 1195-1220, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yeawon Yoo & Adolfo R. Escobedo, 2021. "A New Binary Programming Formulation and Social Choice Property for Kemeny Rank Aggregation," Decision Analysis, INFORMS, vol. 18(4), pages 296-320, December.
    2. Fu, Yelin & Lu, Yihe & Yu, Chen & Lai, Kin Keung, 2022. "Inter-country comparisons of energy system performance with the energy trilemma index: An ensemble ranking methodology based on the half-quadratic theory," Energy, Elsevier, vol. 261(PA).
    3. Francisco Salas-Molina & Filippo Bistaffa & Juan A. Rodriguez-Aguilar, 2024. "A General Approach for Computing a Consensus in Group Decision Making That Integrates Multiple Ethical Principles," Papers 2401.07818, arXiv.org, revised Mar 2024.
    4. Morais, Danielle C. & de Almeida, Adiel Teixeira, 2012. "Group decision making on water resources based on analysis of individual rankings," Omega, Elsevier, vol. 40(1), pages 42-52, January.
    5. Yoo, Yeawon & Escobedo, Adolfo R. & Skolfield, J. Kyle, 2020. "A new correlation coefficient for comparing and aggregating non-strict and incomplete rankings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1025-1041.
    6. Subochev, Andrey & Aleskerov, Fuad & Pislyakov, Vladimir, 2018. "Ranking journals using social choice theory methods: A novel approach in bibliometrics," Journal of Informetrics, Elsevier, vol. 12(2), pages 416-429.
    7. Antonio D’Ambrosio & Carmela Iorio & Michele Staiano & Roberta Siciliano, 2019. "Median constrained bucket order rank aggregation," Computational Statistics, Springer, vol. 34(2), pages 787-802, June.
    8. Salas-Molina, Francisco & Bistaffa, Filippo & Rodríguez-Aguilar, Juan A., 2023. "A general approach for computing a consensus in group decision making that integrates multiple ethical principles," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    9. Noelia Rico & Camino R. Vela & Raúl Pérez-Fernández & Irene Díaz, 2021. "Reducing the Computational Time for the Kemeny Method by Exploiting Condorcet Properties," Mathematics, MDPI, vol. 9(12), pages 1-12, June.
    10. Pushparenu Bhattacharjee & Syed Abou Iltaf Hussain & V. Dey & U. K. Mandal, 2023. "Failure mode and effects analysis for submersible pump component using proportionate risk assessment model: a case study in the power plant of Agartala," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 14(5), pages 1778-1798, October.
    11. Marcus Pivato, 2013. "Voting rules as statistical estimators," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 40(2), pages 581-630, February.
    12. Brandl, Florian & Peters, Dominik, 2022. "Approval voting under dichotomous preferences: A catalogue of characterizations," Journal of Economic Theory, Elsevier, vol. 205(C).
    13. Manfred Padberg, 2005. "Classical Cuts for Mixed-Integer Programming and Branch-and-Cut," Annals of Operations Research, Springer, vol. 139(1), pages 321-352, October.
    14. Kamwa, Eric, 2017. "On stable rules for selecting committees," Journal of Mathematical Economics, Elsevier, vol. 70(C), pages 36-44.
    15. Brandl, Florian & Brandt, Felix & Hofbauer, Johannes, 2019. "Welfare maximization entices participation," Games and Economic Behavior, Elsevier, vol. 114(C), pages 308-314.
    16. Francisco Pedroche & J. Alberto Conejero, 2020. "Corrected Evolutive Kendall’s τ Coefficients for Incomplete Rankings with Ties: Application to Case of Spotify Lists," Mathematics, MDPI, vol. 8(10), pages 1-30, October.
    17. Aardal, K. & van Hoesel, C.P.M., 1995. "Polyhedral techniques in combinatorial optimization," Research Memorandum 014, Maastricht University, Maastricht Research School of Economics of Technology and Organization (METEOR).
    18. Antonella Plaia & Mariangela Sciandra, 2019. "Weighted distance-based trees for ranking data," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 13(2), pages 427-444, June.
    19. Andrea C. Hupman & Jay Simon, 2023. "The Legacy of Peter Fishburn: Foundational Work and Lasting Impact," Decision Analysis, INFORMS, vol. 20(1), pages 1-15, March.
    20. Malandraki, Chryssi & Dial, Robert B., 1996. "A restricted dynamic programming heuristic algorithm for the time dependent traveling salesman problem," European Journal of Operational Research, Elsevier, vol. 90(1), pages 45-55, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:119:y:2023:i:c:s0305048323000579. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.