IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v307y2023i3p1299-1317.html
   My bibliography  Save this article

A subgroup dominance-based benefit of the doubt method for addressing rank reversals: A case study of the human development index in Europe

Author

Listed:
  • Su, Weihua
  • Chen, Sibo
  • Zhang, Chonghui
  • Li, Kevin W.

Abstract

The benefit of the doubt (BoD) is a non-parametric weighting method that aims to maximize the relative composite indicator value of each decision-making unit (DMU). A well-known issue of BoD-based ranking of DMUs is the rank reversal problem when DMUs are deleted or added. The fundamental reason for rank reversals is that deleting (or adding) a DMU influences the generated weight by changing the frontier surface. To address the rank reversal problem, this paper proposes a subgroup dominance-based BoD model (SD-BoD). Based on the individual weights obtained from a classic BoD model, a dominance-based pairwise comparison mechanism is put forward to ensure comparability of different DMUs. Moreover, motivated by the data envelopment analysis idea, we construct a sequential frontier surface partition technique and establish a DMU ranking framework based on subgroup dominance, which helps reduce weight variation due to DMU addition or deletion. Finally, the effectiveness of the SD-BoD method is illustrated by comparing and analyzing the Human Development Indices of the 28 European regions.

Suggested Citation

  • Su, Weihua & Chen, Sibo & Zhang, Chonghui & Li, Kevin W., 2023. "A subgroup dominance-based benefit of the doubt method for addressing rank reversals: A case study of the human development index in Europe," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1299-1317.
    • Handle: RePEc:eee:ejores:v:307:y:2023:i:3:p:1299-1317
    DOI: 10.1016/j.ejor.2022.11.030
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221722008876
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ejor.2022.11.030?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Blancard, Stéphane & Hoarau, Jean-François, 2013. "A new sustainable human development indicator for small island developing states: A reappraisal from data envelopment analysis," Economic Modelling, Elsevier, vol. 30(C), pages 623-635.
    3. Chu, Junfei & Zhu, Joe, 2021. "Production scale-based two-stage network data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 294(1), pages 283-294.
    4. Triantaphyllou, Evangelos & Yanase, Juri & Hou, Fujun, 2020. "Post-consensus analysis of group decision making processes by means of a graph theoretic and an association rules mining approach," Omega, Elsevier, vol. 94(C).
    5. Oleg Badunenko & Daniel J. Henderson & Subal C. Kumbhakar, 2012. "When, where and how to perform efficiency estimation," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 175(4), pages 863-892, October.
    6. Fusco, Elisa & Vidoli, Francesco & Rogge, Nicky, 2020. "Spatial directional robust Benefit of the Doubt approach in presence of undesirable output: An application to Italian waste sector," Omega, Elsevier, vol. 94(C).
    7. Knox Lovell, C. A. & Pastor, Jesus T. & Turner, Judi A., 1995. "Measuring macroeconomic performance in the OECD: A comparison of European and non-European countries," European Journal of Operational Research, Elsevier, vol. 87(3), pages 507-518, December.
    8. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    9. Hassen Gaaloul & Soulef Khalfallah, 2014. "Application of the “Benefit-Of-the-Doubt” Approach for the Construction of a Digital Access Indicator: A Revaluation of the “Digital Access Index”," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 118(1), pages 45-56, August.
    10. Karagiannis, Roxani & Karagiannis, Giannis, 2018. "Intra- and inter-group composite indicators using the BoD model," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 44-51.
    11. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    12. Gong, Chengzhu & Gong, Nianjiao & Qi, Rui & Yu, Shiwei, 2020. "Assessment of natural gas supply security in Asia Pacific: Composite indicators with compromise Benefit-of-the-Doubt weights," Resources Policy, Elsevier, vol. 67(C).
    13. Green, Rodney H. & Doyle, John R. & Cook, Wade D., 1996. "Preference voting and project ranking using DEA and cross-evaluation," European Journal of Operational Research, Elsevier, vol. 90(3), pages 461-472, May.
    14. Rogge, Nicky, 2018. "Composite indicators as generalized benefit-of-the-doubt weighted averages," European Journal of Operational Research, Elsevier, vol. 267(1), pages 381-392.
    15. Hussein Sayed & Ramadan Hamed & Mohamed Ramadan & Samaa Hosny, 2015. "Using Meta-goal Programming for a New Human Development Indicator with Distinguishable Country Ranks," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 123(1), pages 1-27, August.
    16. Rogge, Nicky, 2012. "Undesirable specialization in the construction of composite policy indicators: The Environmental Performance Index," Working Papers 2012/08, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    17. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    18. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    19. Liu, Xianliang & Ma, Yonghao, 2021. "A method to analyze the rank reversal problem in the ELECTRE II method," Omega, Elsevier, vol. 102(C).
    20. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    21. Rezaei, Jafar, 2015. "Best-worst multi-criteria decision-making method," Omega, Elsevier, vol. 53(C), pages 49-57.
    22. Hussein Sayed & Ramadan Hamed & Samaa Hazem Hosny & Alyaa Hegazy Abdelhamid, 2018. "Avoiding Ranking Contradictions in Human Development Index Using Goal Programming," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(2), pages 405-442, July.
    23. Wang, Xiaoting & Triantaphyllou, Evangelos, 2008. "Ranking irregularities when evaluating alternatives by using some ELECTRE methods," Omega, Elsevier, vol. 36(1), pages 45-63, February.
    24. Lisa Bross & Ina Wienand & Steffen Krause, 2020. "Batten Down the Hatches—Assessing the Status of Emergency Preparedness Planning in the German Water Supply Sector with Statistical and Expert-Based Weighting," Sustainability, MDPI, vol. 12(17), pages 1-23, September.
    25. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chengjun Liu & Jingwen Tu & Yong He, 2023. "Measurement of China's Human Development Index and Analysis of Its Influencing Factors from the Perspective of New Development Concept," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 167(1), pages 213-268, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    2. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    3. Rogge, Nicky, 2018. "Composite indicators as generalized benefit-of-the-doubt weighted averages," European Journal of Operational Research, Elsevier, vol. 267(1), pages 381-392.
    4. Rogge, Nicky & Archer, Geoffrey, 2021. "Measuring and analyzing country change in establishing ease of doing business using a revised version of World Bank's ease of doing business index," European Journal of Operational Research, Elsevier, vol. 290(1), pages 373-385.
    5. Giuseppe Coco & Raffaele Lagravinese & Giuliano Resce, 2020. "Beyond the weights: a multicriteria approach to evaluate inequality in education," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 18(4), pages 469-489, December.
    6. Laurens CHERCHYE & Willem MOESEN & Nicky ROGGE & Tom VAN PUYENBROECK, 2009. "Constructing a knowledge economy composite indicator with imprecise data," Working Papers of Department of Economics, Leuven ces09.15, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    7. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.
    8. Athanassoglou, Stergios, 2015. "Revisiting Worst-case DEA for Composite Indicators," Climate Change and Sustainable Development 198712, Fondazione Eni Enrico Mattei (FEEM).
    9. Nicky Rogge & Ilse Nijverseel, 2019. "Quality of Life in the European Union: A Multidimensional Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(2), pages 765-789, January.
    10. Chao Shi & Kenneth C. Land, 2021. "The Data Envelopment Analysis and Equal Weights/Minimax Methods of Composite Social Indicator Construction: a Methodological Study of Data Sensitivity and Robustness," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 16(4), pages 1689-1716, August.
    11. Fu-Chiang Yang & Rui-Hsin Kao & Yi-Tui Chen & Yueh-Fei Ho & Cheng-Chung Cho & Shi-Wei Huang, 2018. "A Common Weight Approach to Construct Composite Indicators: The Evaluation of Fourteen Emerging Markets," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 137(2), pages 463-479, June.
    12. Verbunt, Pim & Rogge, Nicky, 2018. "Geometric composite indicators with compromise Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 264(1), pages 388-401.
    13. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    14. Oliveira, Renata & Zanella, Andreia & Camanho, Ana S., 2019. "The assessment of corporate social responsibility: The construction of an industry ranking and identification of potential for improvement," European Journal of Operational Research, Elsevier, vol. 278(2), pages 498-513.
    15. Lampe, Hannes W. & Hilgers, Dennis, 2015. "Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA," European Journal of Operational Research, Elsevier, vol. 240(1), pages 1-21.
    16. Stergios Athanassoglou, 2016. "Revisiting Worst-Case DEA for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(3), pages 1259-1272, September.
    17. Francesco Vidoli & Elisa Fusco & Claudio Mazziotta, 2015. "Non-compensability in Composite Indicators: A Robust Directional Frontier Method," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 122(3), pages 635-652, July.
    18. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    19. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    20. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:307:y:2023:i:3:p:1299-1317. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.