IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v288y2021i1p225-246.html
   My bibliography  Save this article

The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method

Author

Listed:
  • Greco, Salvatore
  • Ishizaka, Alessio
  • Tasiou, Menelaos
  • Torrisi, Gianpiero

Abstract

Despite serious threats as to their soundness, the adoption of composite indicators is constantly growing alongside their popularity, especially when it comes to their adoption in policy-making exercises. This study presents a robust non-compensatory approach to construct composite indicators that is mainly based, at least with respect to the basic ideas, on the classic Borda scoring procedure. The non-compensatory indicators we are proposing can be seen as aggregation of ordinal non-compensatory preferences between considered units supplying a numerical cardinal comprehensive evaluation. For this reason, we define our methodology, the ordinal input for cardinal output non-compensatory approach for composite indicators. To take into account hesitation, imprecision and ill-determination in defining preference relations with respect to the elementary indices, we adopt the PROMETHEE methods, whose net flow score can be seen as an extension to the fuzzy preferences of the Borda score. Moreover, we systematically deal with robustness of the results with respect to weighting and parameters such as indifference and preference thresholds, allowing to define preference relations of elementary indices. In this regard, we couple PROMETHEE methods with the recently proposed σ−μ approach, which permits to explore the whole domain of feasible preference parameters mentioned above, giving a synthetic representation of the distribution of the values assumed by the composite indicators in terms of mean, μ, and standard deviation, σ. μ and σ are also used to define a comprehensive overall composite indicator. Finally, we enrich the results of this analysis with a set of graphical visualizations based on principal component analysis applied to the PROMETHEE methods with the GAIA technique, providing better understanding of the outcomes of our approach. To illustrate its assets, we provide a case study of inclusive development evaluation, based on the data of the homonymous report produced by the World Economic Forum.

Suggested Citation

  • Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2021. "The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method," European Journal of Operational Research, Elsevier, vol. 288(1), pages 225-246.
  • Handle: RePEc:eee:ejores:v:288:y:2021:i:1:p:225-246
    DOI: 10.1016/j.ejor.2020.05.036
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221720304823
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2020.05.036?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Shmuel Nitzan & Ariel Rubinstein, 1981. "A further characterization of Borda ranking method," Public Choice, Springer, vol. 36(1), pages 153-158, January.
    3. Grupp, Hariolf & Schubert, Torben, 2010. "Review and new evidence on composite innovation indicators for evaluating national performance," Research Policy, Elsevier, vol. 39(1), pages 67-78, February.
    4. Peter C. Fishburn, 1975. "Axioms for Lexicographic Preferences," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 42(3), pages 415-419.
    5. Seiford, Lawrence M. & Zhu, Joe, 2003. "Context-dependent data envelopment analysis--Measuring attractiveness and progress," Omega, Elsevier, vol. 31(5), pages 397-408, October.
    6. Duncan Black, 1976. "Partial justification of the Borda count," Public Choice, Springer, vol. 28(1), pages 1-15, December.
    7. Giuseppe Munda, 2012. "Choosing Aggregation Rules for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 109(3), pages 337-354, December.
    8. Tervonen, Tommi & Lahdelma, Risto, 2007. "Implementing stochastic multicriteria acceptability analysis," European Journal of Operational Research, Elsevier, vol. 178(2), pages 500-513, April.
    9. repec:hal:wpspec:info:hdl:2441/5l6uh8ogmqildh09h4687h53k is not listed on IDEAS
    10. Charles R. Plott & James T. Little & Robert P. Parks, 1975. "Individual Choice when Objects have "Ordinal" Properties," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 42(3), pages 403-413.
    11. Kubiszewski, Ida & Costanza, Robert & Franco, Carol & Lawn, Philip & Talberth, John & Jackson, Tim & Aylmer, Camille, 2013. "Beyond GDP: Measuring and achieving global genuine progress," Ecological Economics, Elsevier, vol. 93(C), pages 57-68.
    12. Lahdelma, Risto & Hokkanen, Joonas & Salminen, Pekka, 1998. "SMAA - Stochastic multiobjective acceptability analysis," European Journal of Operational Research, Elsevier, vol. 106(1), pages 137-143, April.
    13. Bouyssou, Denis, 1986. "Some remarks on the notion of compensation in MCDM," European Journal of Operational Research, Elsevier, vol. 26(1), pages 150-160, July.
    14. Loomes, Graham & Sugden, Robert, 1982. "Regret Theory: An Alternative Theory of Rational Choice under Uncertainty," Economic Journal, Royal Economic Society, vol. 92(368), pages 805-824, December.
    15. Angilella, Silvia & Corrente, Salvatore & Greco, Salvatore & Słowiński, Roman, 2016. "Robust Ordinal Regression and Stochastic Multiobjective Acceptability Analysis in multiple criteria hierarchy process for the Choquet integral preference model," Omega, Elsevier, vol. 63(C), pages 154-169.
    16. Joseph Stiglitz & Amartya Sen & Jean-Paul Fitoussi, 2009. "The measurement of economic performance and social progress revisited: Reflections and Overview," Sciences Po publications 2009-33, Sciences Po.
    17. Jean-Philippe Hubinont, 2016. "SMAA-GAIA: a complementary tool of the SMAA-PROMETHEE method," International Journal of Multicriteria Decision Making, Inderscience Enterprises Ltd, vol. 6(3), pages 237-246.
    18. Dasgupta, Partha & Weale, Martin, 1992. "On measuring the quality of life," World Development, Elsevier, vol. 20(1), pages 119-131, January.
    19. Thierry Marchant, 2000. "Does the Borda rule provide more than a ranking?," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 17(3), pages 381-391.
    20. Joseph E. Stiglitz & Amartya Sen & Jean-Paul Fitoussi, 2009. "The measurement of economic performance and social progress revisited," Documents de Travail de l'OFCE 2009-33, Observatoire Francais des Conjonctures Economiques (OFCE).
    21. Daniel Kahneman & Amos Tversky, 2013. "Prospect Theory: An Analysis of Decision Under Risk," World Scientific Book Chapters, in: Leonard C MacLean & William T Ziemba (ed.), HANDBOOK OF THE FUNDAMENTALS OF FINANCIAL DECISION MAKING Part I, chapter 6, pages 99-127, World Scientific Publishing Co. Pte. Ltd..
    22. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    23. Salvatore Corrente & Salvatore Greco & Roman Słowiński, 2019. "Robust Ranking of Universities Evaluated by Hierarchical and Interacting Criteria," International Series in Operations Research & Management Science, in: Sandra Huber & Martin Josef Geiger & Adiel Teixeira de Almeida (ed.), Multiple Criteria Decision Making and Aiding, pages 145-192, Springer.
    24. David E. Bell, 1982. "Regret in Decision Making under Uncertainty," Operations Research, INFORMS, vol. 30(5), pages 961-981, October.
    25. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    26. Angilella, Silvia & Corrente, Salvatore & Greco, Salvatore, 2015. "Stochastic multiobjective acceptability analysis for the Choquet integral preference model and the scale construction problem," European Journal of Operational Research, Elsevier, vol. 240(1), pages 172-182.
    27. J. P. Brans & Ph. Vincke, 1985. "Note---A Preference Ranking Organisation Method," Management Science, INFORMS, vol. 31(6), pages 647-656, June.
    28. Mareschal, Bertrand & Brans, Jean-Pierre, 1988. "Geometrical representations for MCDA," European Journal of Operational Research, Elsevier, vol. 34(1), pages 69-77, February.
    29. Peter C. Fishburn, 1974. "Exceptional Paper--Lexicographic Orders, Utilities and Decision Rules: A Survey," Management Science, INFORMS, vol. 20(11), pages 1442-1471, July.
    30. repec:hal:spmain:info:hdl:2441/5l6uh8ogmqildh09h4687h53k is not listed on IDEAS
    31. Bertrand Mareschal & Jean Pierre Brans & Philippe Vincke, 1986. "How to select and how to rank projects: the Prométhée method," ULB Institutional Repository 2013/9307, ULB -- Universite Libre de Bruxelles.
    32. Risto Lahdelma & Pekka Salminen, 2001. "SMAA-2: Stochastic Multicriteria Acceptability Analysis for Group Decision Making," Operations Research, INFORMS, vol. 49(3), pages 444-454, June.
    33. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    34. Gül Özerol & Esra Karasakal, 2008. "A Parallel between Regret Theory and Outranking Methods for Multicriteria Decision Making Under Imprecise Information," Theory and Decision, Springer, vol. 65(1), pages 45-70, August.
    35. Attardi, Raffaele & Cerreta, Maria & Sannicandro, Valentina & Torre, Carmelo Maria, 2018. "Non-compensatory composite indicators for the evaluation of urban planning policy: The Land-Use Policy Efficiency Index (LUPEI)," European Journal of Operational Research, Elsevier, vol. 264(2), pages 491-507.
    36. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    37. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    38. Brans, J. P. & Vincke, Ph. & Mareschal, B., 1986. "How to select and how to rank projects: The method," European Journal of Operational Research, Elsevier, vol. 24(2), pages 228-238, February.
    39. repec:dau:papers:123456789/2947 is not listed on IDEAS
    40. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    41. Zhang, L.P. & Zhou, P., 2018. "A non-compensatory composite indicator approach to assessing low-carbon performance," European Journal of Operational Research, Elsevier, vol. 270(1), pages 352-361.
    42. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    43. Marchant, Thierry, 1998. "Cardinality and the borda score," European Journal of Operational Research, Elsevier, vol. 108(2), pages 464-472, July.
    44. Kenneth J. Arrow & Herve Raynaud, 1986. "Social Choice and Multicriterion Decision-Making," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262511754, December.
    45. Gianluigi De Mare & Maria Fiorella Granata & Antonio Nesticò, 2015. "Weak and Strong Compensation for the Prioritization of Public Investments: Multidimensional Analysis for Pools," Sustainability, MDPI, vol. 7(12), pages 1-17, December.
    46. Ishizaka, Alessio & Siraj, Sajid & Nemery, Philippe, 2016. "Which energy mix for the UK (United Kingdom)? An evolutive descriptive mapping with the integrated GAIA (graphical analysis for interactive aid)–AHP (analytic hierarchy process) visualization tool," Energy, Elsevier, vol. 95(C), pages 602-611.
    47. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore, 2014. "The SMAA-PROMETHEE method," European Journal of Operational Research, Elsevier, vol. 239(2), pages 514-522.
    48. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2018. "GAIA-SMAA-PROMETHEE for a hierarchy of interacting criteria," European Journal of Operational Research, Elsevier, vol. 270(2), pages 606-624.
    49. Michael Doumpos & Chrysovalantis Gaganis & Fotios Pasiouras, 2016. "Bank Diversification and Overall Financial Strength: International Evidence," Working Papers 1602, University of Crete, Department of Economics.
    50. Denis Bouyssou & Jean-Claude Vansnick, 1986. "Noncompensatory and generalized noncompensatory preference structures," Post-Print hal-02920182, HAL.
    51. Frederik Booysen, 2002. "An Overview and Evaluation of Composite Indices of Development," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 59(2), pages 115-151, August.
    52. Matteo Mazziotta & Adriano Pareto, 2016. "On a Generalized Non-compensatory Composite Index for Measuring Socio-economic Phenomena," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 127(3), pages 983-1003, July.
    53. Salvatore Greco & Alessio Ishizaka & Benedetto Matarazzo & Gianpiero Torrisi, 2018. "Stochastic multi-attribute acceptability analysis (SMAA): an application to the ranking of Italian regions," Regional Studies, Taylor & Francis Journals, vol. 52(4), pages 585-600, April.
    54. Greco, Salvatore & Ishizaka, Alessio & Resce, Giuliano & Torrisi, Gianpiero, 2017. "Is the Grass Always Greener on the Other Side of the fence? Composite Index of Well-Being Taking into Account the Local Relative Appreciations in Better Life Index," MPRA Paper 82718, University Library of Munich, Germany.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Peiró-Palomino, Jesús & Picazo-Tadeo, Andrés J. & Tortosa-Ausina, Emili, 2021. "Measuring well-being in Colombian departments. The role of geography and demography," Socio-Economic Planning Sciences, Elsevier, vol. 78(C).
    2. Qi, Yue & Liao, Kezhi & Liu, Tongyang & Zhang, Yu, 2022. "Originating multiple-objective portfolio selection by counter-COVID measures and analytically instigating robust optimization by mean-parameterized nondominated paths," Operations Research Perspectives, Elsevier, vol. 9(C).
    3. Figueira, José Rui & Greco, Salvatore & Roy, Bernard, 2022. "Electre-Score: A first outranking based method for scoring actions," European Journal of Operational Research, Elsevier, vol. 297(3), pages 986-1005.
    4. Arunodaya Raj Mishra & Ayushi Chandel & Parvaneh Saeidi, 2022. "Low-carbon tourism strategy evaluation and selection using interval-valued intuitionistic fuzzy additive ratio assessment approach based on similarity measures," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 24(5), pages 7236-7282, May.
    5. Sarah Ben Amor & Fateh Belaid & Ramzi Benkraiem & Boumediene Ramdani & Khaled Guesmi, 2023. "Multi-criteria classification, sorting, and clustering: a bibliometric review and research agenda," Annals of Operations Research, Springer, vol. 325(2), pages 771-793, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "The Ordinal Input for Cardinal Output Approach of Non-compensatory Composite Indicators: The PROMETHEE Scoring Method," MPRA Paper 95816, University Library of Munich, Germany.
    2. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    3. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    4. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    5. R. Pelissari & M. C. Oliveira & S. Ben Amor & A. Kandakoglu & A. L. Helleno, 2020. "SMAA methods and their applications: a literature review and future research directions," Annals of Operations Research, Springer, vol. 293(2), pages 433-493, October.
    6. Gaganis, Chrysovalantis & Pasiouras, Fotios & Tasiou, Menelaos & Zopounidis, Constantin, 2021. "CISEF: A composite index of social, environmental and financial performance," European Journal of Operational Research, Elsevier, vol. 291(1), pages 394-409.
    7. Chrysovalantis Gaganis & Panagiota Papadimitri & Menelaos Tasiou, 2021. "A multicriteria decision support tool for modelling bank credit ratings," Annals of Operations Research, Springer, vol. 306(1), pages 27-56, November.
    8. Ishizaka, Alessio & Lokman, Banu & Tasiou, Menelaos, 2021. "A Stochastic Multi-criteria divisive hierarchical clustering algorithm," Omega, Elsevier, vol. 103(C).
    9. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    10. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    11. Giuliano Resce & Fritz Schiltz, 2021. "Sustainable Development in Europe: A Multicriteria Decision Analysis," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(2), pages 509-529, June.
    12. Arcidiacono, Sally Giuseppe & Corrente, Salvatore & Greco, Salvatore, 2021. "Robust stochastic sorting with interacting criteria hierarchically structured," European Journal of Operational Research, Elsevier, vol. 292(2), pages 735-754.
    13. Giuseppe Coco & Raffaele Lagravinese & Giuliano Resce, 2020. "Beyond the weights: a multicriteria approach to evaluate inequality in education," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 18(4), pages 469-489, December.
    14. Greco, Salvatore & Ishizaka, Alessio & Matarazzo, Benedetto & Torrisi, Gianpiero, 2015. "Stochastic Multiattribute Acceptability Analysis: an application to the ranking of Italian regions," MPRA Paper 68508, University Library of Munich, Germany.
    15. Giuseppe Munda, 2012. "Intensity of preference and related uncertainty in non-compensatory aggregation rules," Theory and Decision, Springer, vol. 73(4), pages 649-669, October.
    16. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    17. Ruiz, Francisco & El Gibari, Samira & Cabello, José M. & Gómez, Trinidad, 2020. "MRP-WSCI: Multiple reference point based weak and strong composite indicators," Omega, Elsevier, vol. 95(C).
    18. De Matteis, Domenico & Ishizaka, Alessio & Resce, Giuliano, 2019. "The ‘postcode lottery’ of the Italian public health bill analysed with the hierarchy Stochastic Multiobjective Acceptability Analysis," Socio-Economic Planning Sciences, Elsevier, vol. 68(C).
    19. Ana Garcia-Bernabeu & Adolfo Hilario-Caballero, 2021. "Monitoring multidimensional phenomena with a multicriteria composite performance interval approach," Papers 2107.08393, arXiv.org.
    20. Cinelli, Marco & Kadziński, Miłosz & Gonzalez, Michael & Słowiński, Roman, 2020. "How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy," Omega, Elsevier, vol. 96(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:288:y:2021:i:1:p:225-246. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.