IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v52y2006i9p1394-1408.html
   My bibliography  Save this article

Methodologies and Algorithms for Group-Rankings Decision

Author

Listed:
  • Dorit S. Hochbaum

    (Department of Industrial Engineering and Operations Research, and Walter A. Haas School of Business, University of California, Berkeley, Berkeley, California 94720)

  • Asaf Levin

    (Department of Statistics, The Hebrew University, Jerusalem 91905, Israel)

Abstract

The problem of group ranking, also known as rank aggregation, has been studied in contexts varying from sports, to multicriteria decision making, to machine learning, to ranking Web pages, and to behavioral issues. The dynamics of the group aggregation of individual decisions has been a subject of central importance in decision theory. We present here a new paradigm using an optimization framework that addresses major shortcomings that exist in current models of group ranking. Moreover, the framework provides a specific performance measure for the quality of the aggregate ranking as per its deviations from the individual decision-makers' rankings. The new model for the group-ranking problem presented here is based on rankings provided with intensity--that is, the degree of preference is quantified. The model allows for flexibility in decision protocols and can take into consideration imprecise beliefs, less than full confidence in some of the rankings, and differentiating between the expertise of the reviewers. Our approach relaxes frequently made assumptions of: certain beliefs in pairwise rankings; homogeneity implying equal expertise of all decision makers with respect to all evaluations; and full list requirement according to which each decision maker evaluates and ranks all objects. The option of preserving the ranks in certain subsets is also addressed in the model here. Significantly, our model is a natural extension and generalization of existing models, yet it is solvable in polynomial time. The group-rankings models are linked to network flow techniques.

Suggested Citation

  • Dorit S. Hochbaum & Asaf Levin, 2006. "Methodologies and Algorithms for Group-Rankings Decision," Management Science, INFORMS, vol. 52(9), pages 1394-1408, September.
  • Handle: RePEc:inm:ormnsc:v:52:y:2006:i:9:p:1394-1408
    DOI: 10.1287/mnsc.1060.0540
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.1060.0540
    Download Restriction: no

    File URL: https://libkey.io/10.1287/mnsc.1060.0540?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Wade D. Cook & Boaz Golany & Moshe Kress & Michal Penn & Tal Raviv, 2005. "Optimal Allocation of Proposals to Reviewers to Facilitate Effective Ranking," Management Science, INFORMS, vol. 51(4), pages 655-661, April.
    2. Ravindra K. Ahuja & Dorit S. Hochbaum & James B. Orlin, 2003. "Solving the Convex Cost Integer Dual Network Flow Problem," Management Science, INFORMS, vol. 49(7), pages 950-964, July.
    3. Iqbal Ali & Wade D. Cook & Moshe Kress, 1986. "Note---Ordinal Ranking and Intensity of Preference: A Linear Programming Approach," Management Science, INFORMS, vol. 32(12), pages 1642-1647, December.
    4. Thomas L. Saaty & Luis G. Vargas, 1998. "Diagnosis with Dependent Symptoms: Bayes Theorem and the Analytic Hierarchy Process," Operations Research, INFORMS, vol. 46(4), pages 491-502, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kannan, Devika, 2021. "Sustainable procurement drivers for extended multi-tier context: A multi-theoretical perspective in the Danish supply chain," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 146(C).
    2. Xia Liu & Yejun Xu & Yao Ge & Weike Zhang & Francisco Herrera, 2019. "A Group Decision Making Approach Considering Self-Confidence Behaviors and Its Application in Environmental Pollution Emergency Management," IJERPH, MDPI, vol. 16(3), pages 1-15, January.
    3. Wu, Siqi & Wu, Meng & Dong, Yucheng & Liang, Haiming & Zhao, Sihai, 2020. "The 2-rank additive model with axiomatic design in multiple attribute decision making," European Journal of Operational Research, Elsevier, vol. 287(2), pages 536-545.
    4. Li-Ching Ma, 2018. "Discovering Consensus Preferences Visually Based on Gower Plots," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 17(03), pages 741-761, May.
    5. Hengjie Zhang & Fang Wang & Huali Tang & Yucheng Dong, 2019. "An Optimization-Based Approach to Social Network Group Decision Making with an Application to Earthquake Shelter-Site Selection," IJERPH, MDPI, vol. 16(15), pages 1-16, July.
    6. Karol Flores-Szwagrzak & Rafael Treibich, 2020. "Teamwork and Individual Productivity," Management Science, INFORMS, vol. 66(6), pages 2523-2544, June.
    7. Zhang, Hengjie & Dong, Yucheng & Chiclana, Francisco & Yu, Shui, 2019. "Consensus efficiency in group decision making: A comprehensive comparative study and its optimal design," European Journal of Operational Research, Elsevier, vol. 275(2), pages 580-598.
    8. Tomashevskii, I.L., 2015. "Eigenvector ranking method as a measuring tool: Formulas for errors," European Journal of Operational Research, Elsevier, vol. 240(3), pages 774-780.
    9. Paulo Cesar Schotten & Leydiana Sousa Pereira & Danielle Costa Morais, 2022. "Credit granting sorting model for financial organizations," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 8(1), pages 1-24, December.
    10. Gong, Zaiwu & Guo, Weiwei & Słowiński, Roman, 2021. "Transaction and interaction behavior-based consensus model and its application to optimal carbon emission reduction," Omega, Elsevier, vol. 104(C).
    11. Dorit S. Hochbaum & Erick Moreno-Centeno & Phillip Yelland & Rodolfo A. Catena, 2011. "Rating Customers According to Their Promptness to Adopt New Products," Operations Research, INFORMS, vol. 59(5), pages 1171-1183, October.
    12. Ma, Li-Ching, 2010. "Visualizing preferences on spheres for group decisions based on multiplicative preference relations," European Journal of Operational Research, Elsevier, vol. 203(1), pages 176-184, May.
    13. Cheng, Li-Chen & Chen, Yen-Liang & Chiang, Yu-Chia, 2016. "Identifying conflict patterns to reach a consensus – A novel group decision approach," European Journal of Operational Research, Elsevier, vol. 254(2), pages 622-631.
    14. Sha Fan & Hengjie Zhang & Huali Tang, 2019. "A Linguistic Hierarchy Model with Self-Confidence Preference Relations and Its Application in Co-Regulation of Food Safety in China," IJERPH, MDPI, vol. 16(16), pages 1-21, August.
    15. Roemer, Thomas A. & Ahmadi, Reza, 2010. "Models for concurrent product and process design," European Journal of Operational Research, Elsevier, vol. 203(3), pages 601-613, June.
    16. Bianchi, Federico & Grimaldo, Francisco & Squazzoni, Flaminio, 2019. "The F3-index. Valuing reviewers for scholarly journals," Journal of Informetrics, Elsevier, vol. 13(1), pages 78-86.
    17. Chen, Yen-Liang & Cheng, Li-Chen, 2009. "Mining maximum consensus sequences from group ranking data," European Journal of Operational Research, Elsevier, vol. 198(1), pages 241-251, October.
    18. Fu, Yelin & Lu, Yihe & Yu, Chen & Lai, Kin Keung, 2022. "Inter-country comparisons of energy system performance with the energy trilemma index: An ensemble ranking methodology based on the half-quadratic theory," Energy, Elsevier, vol. 261(PA).
    19. Marco Marozzi, 2016. "Construction, Robustness Assessment and Application of an Index of Perceived Level of Socio-Economic Threat from Immigrants: A Study of 47 European Countries and Regions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(1), pages 413-437, August.
    20. Tianjiao Wang & Yelin Fu, 2020. "Constructing Composite Indicators with Individual Judgements and Best–Worst Method: An Illustration of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(1), pages 1-14, May.
    21. Yoo, Yeawon & Escobedo, Adolfo R. & Skolfield, J. Kyle, 2020. "A new correlation coefficient for comparing and aggregating non-strict and incomplete rankings," European Journal of Operational Research, Elsevier, vol. 285(3), pages 1025-1041.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nathan Atkinson & Scott C. Ganz & Dorit S. Hochbaum & James B. Orlin, 2023. "The Strong Maximum Circulation Algorithm: A New Method for Aggregating Preference Rankings," Papers 2307.15702, arXiv.org, revised Jan 2024.
    2. Fernandez Martinez, Roberto & Lostado Lorza, Ruben & Santos Delgado, Ana Alexandra & Piedra, Nelson, 2021. "Use of classification trees and rule-based models to optimize the funding assignment to research projects: A case study of UTPL," Journal of Informetrics, Elsevier, vol. 15(1).
    3. Bhowmik, Chiranjib & Bhowmik, Sumit & Ray, Amitava & Pandey, Krishna Murari, 2017. "Optimal green energy planning for sustainable development: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 71(C), pages 796-813.
    4. Tsai, Wen-Hsien & Hsu, Jui-Ling, 2008. "Corporate social responsibility programs choice and costs assessment in the airline industry—A hybrid model," Journal of Air Transport Management, Elsevier, vol. 14(4), pages 188-196.
    5. Shin-Liang Chan & Wann-Ming Wey & Pin-Huai Chang, 2014. "Establishing Disaster Resilience Indicators for Tan-sui River Basin in Taiwan," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 115(1), pages 387-418, January.
    6. Lo, Huai-Wei & Liou, James J.H. & Huang, Chun-Nen & Chuang, Yen-Ching & Tzeng, Gwo-Hshiung, 2020. "A new soft computing approach for analyzing the influential relationships of critical infrastructures," International Journal of Critical Infrastructure Protection, Elsevier, vol. 28(C).
    7. Bürgy, Reinhard & Bülbül, Kerem, 2018. "The job shop scheduling problem with convex costs," European Journal of Operational Research, Elsevier, vol. 268(1), pages 82-100.
    8. Tavana, M. & Kennedy, D. T. & Joglekar, P., 1996. "A group decision support framework for consensus ranking of technical manager candidates," Omega, Elsevier, vol. 24(5), pages 523-538, October.
    9. Carlo Mannino & Alessandro Mascis, 2009. "Optimal Real-Time Traffic Control in Metro Stations," Operations Research, INFORMS, vol. 57(4), pages 1026-1039, August.
    10. Kayakutlu, Gulgun & Buyukozkan, Gulcin, 2011. "Assessing performance factors for a 3PL in a value chain," International Journal of Production Economics, Elsevier, vol. 131(2), pages 441-452, June.
    11. Katarína Cechlárová & Tamás Fleiner & Eva Potpinková, 2014. "Assigning evaluators to research grant applications: the case of Slovak Research and Development Agency," Scientometrics, Springer;Akadémiai Kiadó, vol. 99(2), pages 495-506, May.
    12. Chia-Liang Lin & Jwu-Jenq Chen & Yu-Yu Ma, 2023. "Ranking of Service Quality Solution for Blended Design Teaching Using Fuzzy ANP and TOPSIS in the Post-COVID-19 Era," Mathematics, MDPI, vol. 11(5), pages 1-28, March.
    13. Matthew Liberatore & Robert Nydick & Constantine Daskalakis & Elisabeth Kunkel & James Cocroft & Ronald Myers, 2009. "Helping Men Decide About Scheduling a Prostate Cancer Screening Exam," Interfaces, INFORMS, vol. 39(3), pages 209-217, June.
    14. Jin-Ling Yan & Yong-Jie Xue & Muhammad Mohsin, 2022. "Accessing Occupational Health Risks Posed by Fishermen Based on Fuzzy AHP and IPA Methods: Management and Performance Perspectives," Sustainability, MDPI, vol. 14(20), pages 1-20, October.
    15. Xiaoyu Liu & Xuefeng Wang & Donghua Zhu, 2022. "Reviewer recommendation method for scientific research proposals: a case for NSFC," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3343-3366, June.
    16. Thomas Feliciani & Junwen Luo & Lai Ma & Pablo Lucas & Flaminio Squazzoni & Ana Marušić & Kalpana Shankar, 2019. "A scoping review of simulation models of peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 121(1), pages 555-594, October.
    17. Lin, Yi-Kuei, 2006. "Evaluate the performance of a stochastic-flow network with cost attribute in terms of minimal cuts," Reliability Engineering and System Safety, Elsevier, vol. 91(5), pages 539-545.
    18. Ma, Li-Ching, 2010. "Visualizing preferences on spheres for group decisions based on multiplicative preference relations," European Journal of Operational Research, Elsevier, vol. 203(1), pages 176-184, May.
    19. Cheng, Li-Chen & Chen, Yen-Liang & Chiang, Yu-Chia, 2016. "Identifying conflict patterns to reach a consensus – A novel group decision approach," European Journal of Operational Research, Elsevier, vol. 254(2), pages 622-631.
    20. Muhammad Mohsin & Hengbin Yin & Weilun Huang & Shijun Zhang & Luyao Zhang & Ana Mehak, 2022. "Evaluation of Occupational Health Risk Management and Performance in China: A Case Study of Gas Station Workers," IJERPH, MDPI, vol. 19(7), pages 1-22, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:52:y:2006:i:9:p:1394-1408. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.