IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v278y2019i3p942-960.html
   My bibliography  Save this article

Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators

Author

Listed:
  • Greco, Salvatore
  • Ishizaka, Alessio
  • Tasiou, Menelaos
  • Torrisi, Gianpiero

Abstract

We propose a methodology to employ composite indicators for performance analysis of units of interest using and extending the family of Stochastic Multiattribute Acceptability Analysis. We start evaluating each unit by means of weighted sums of their elementary indicators in the whole set of admissible weights. For each unit, we compute the mean, μ, and the standard deviation, σ, of its evaluations. Clearly, the former has to be maximized, while the latter has to be minimized as it denotes instability in the evaluations with respect to the variability of weights. We consider a unit to be Pareto–Koopmans efficient with respect to μ and σ if there is no convex combination of μ and σ of the rest of the units with a value of μ that is not smaller, and a value of σ that is not greater, with at least one strict inequality. The set of all Pareto–Koopmans efficient units constitutes the first Pareto–Koopmans frontier. In the spirit of context-dependent Data Envelopment Analysis, we assign each unit to one of the sequence of Pareto–Koopmans frontiers. We measure the local efficiency of each unit with respect to each frontier, but also its global efficiency taking into account all frontiers in the σ−μ plane, thus enhancing the explicative power of the proposed approach. To illustrate its potential, we present a case study of ‘world happiness’ based on the data of the homonymous report that is annually produced by the United Nations’ Sustainable Development Solutions Network.

Suggested Citation

  • Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
  • Handle: RePEc:eee:ejores:v:278:y:2019:i:3:p:942-960
    DOI: 10.1016/j.ejor.2019.04.012
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221719303327
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. William W. Cooper & Lawrence M. Seiford & Joe Zhu (ed.), 2011. "Handbook on Data Envelopment Analysis," International Series in Operations Research and Management Science, Springer, number 978-1-4419-6151-8, March.
    3. Itzhak Gilboa & Fabio Maccheroni & Massimo Marinacci & David Schmeidler, 2010. "Objective and Subjective Rationality in a Multiple Prior Model," Econometrica, Econometric Society, vol. 78(2), pages 755-770, March.
    4. Grupp, Hariolf & Schubert, Torben, 2010. "Review and new evidence on composite innovation indicators for evaluating national performance," Research Policy, Elsevier, vol. 39(1), pages 67-78, February.
    5. Léopold Simar & Paul W. Wilson, 1998. "Sensitivity Analysis of Efficiency Scores: How to Bootstrap in Nonparametric Frontier Models," Management Science, INFORMS, vol. 44(1), pages 49-61, January.
    6. Harry Markowitz, 1952. "Portfolio Selection," Journal of Finance, American Finance Association, vol. 7(1), pages 77-91, March.
    7. Seiford, Lawrence M. & Zhu, Joe, 2003. "Context-dependent data envelopment analysis--Measuring attractiveness and progress," Omega, Elsevier, vol. 31(5), pages 397-408, October.
    8. Sen, Amartya, 1970. "Interpersonal Aggregation and Partial Comparability," Econometrica, Econometric Society, vol. 38(3), pages 393-409, May.
    9. Joseph Stiglitz & Amartya K. Sen & Jean-Paul Fitoussi, 2009. "The measurement of economic performance and social progress revisited: Reflections and Overview," Sciences Po publications 2009-33, Sciences Po.
    10. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    11. Alan P. Kirman, 1992. "Whom or What Does the Representative Individual Represent?," Journal of Economic Perspectives, American Economic Association, vol. 6(2), pages 117-136, Spring.
    12. Giuseppe Munda, 2005. "“Measuring Sustainability”: A Multi-Criterion Framework," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 7(1), pages 117-134, January.
    13. Koen Decancq & Luc Van Ootegem & Elsy Verhofstadt, 2013. "What If We Voted on the Weights of a Multidimensional Well‐Being Index? An Illustration with Flemish Data," Fiscal Studies, Institute for Fiscal Studies, vol. 34, pages 315-332, September.
    14. Tervonen, Tommi & Lahdelma, Risto, 2007. "Implementing stochastic multicriteria acceptability analysis," European Journal of Operational Research, Elsevier, vol. 178(2), pages 500-513, April.
    15. repec:spo:wpecon:info:hdl:2441/5l6uh8ogmqildh09h4687h53k is not listed on IDEAS
    16. Amal Ray, 2008. "Measurement of social development: an international comparison," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 86(1), pages 1-46, March.
    17. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    18. Lahdelma, Risto & Hokkanen, Joonas & Salminen, Pekka, 1998. "SMAA - Stochastic multiobjective acceptability analysis," European Journal of Operational Research, Elsevier, vol. 106(1), pages 137-143, April.
    19. Bertrand Mareschal & Jean Pierre Brans & Philippe Vincke, 1986. "How to select and how to rank projects: the Prométhée method," ULB Institutional Repository 2013/9307, ULB -- Universite Libre de Bruxelles.
    20. Hopkins, Michael, 1991. "Human development revisited: A new UNDP report," World Development, Elsevier, vol. 19(10), pages 1469-1473, October.
    21. Risto Lahdelma & Pekka Salminen, 2001. "SMAA-2: Stochastic Multicriteria Acceptability Analysis for Group Decision Making," Operations Research, INFORMS, vol. 49(3), pages 444-454, June.
    22. Kadziński, Miłosz & Tervonen, Tommi, 2013. "Robust multi-criteria ranking with additive value models and holistic pair-wise preference statements," European Journal of Operational Research, Elsevier, vol. 228(1), pages 169-180.
    23. Koen Decancq & María Ana Lugo, 2013. "Weights in Multidimensional Indices of Wellbeing: An Overview," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 7-34, January.
    24. Kortelainen, Mika, 2008. "Dynamic environmental performance analysis: A Malmquist index approach," Ecological Economics, Elsevier, vol. 64(4), pages 701-715, February.
    25. Christian Kroll & Jan Delhey, 2013. "A Happy Nation? Opportunities and Challenges of Using Subjective Indicators in Policymaking," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(1), pages 13-28, October.
    26. Cinzia Daraio & Léopold Simar, 2005. "Introducing Environmental Variables in Nonparametric Frontier Models: a Probabilistic Approach," Journal of Productivity Analysis, Springer, vol. 24(1), pages 93-121, September.
    27. Pasquale De Muro & Matteo Mazziotta & Adriano Pareto, 2011. "Composite Indices of Development and Poverty: An Application to MDGs," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 104(1), pages 1-18, October.
    28. A. Charnes & W. W. Cooper, 1962. "Programming with linear fractional functionals," Naval Research Logistics Quarterly, John Wiley & Sons, vol. 9(3‐4), pages 181-186, September.
    29. Brans, J. P. & Vincke, Ph. & Mareschal, B., 1986. "How to select and how to rank projects: The method," European Journal of Operational Research, Elsevier, vol. 24(2), pages 228-238, February.
    30. Helliwell, John & Layard, Richard & Sachs, Jeffrey, 2012. "World happiness report," LSE Research Online Documents on Economics 47487, London School of Economics and Political Science, LSE Library.
    31. Greco, Salvatore & Mousseau, Vincent & Slowinski, Roman, 2008. "Ordinal regression revisited: Multiple criteria ranking using a set of additive value functions," European Journal of Operational Research, Elsevier, vol. 191(2), pages 416-436, December.
    32. Cinzia Daraio & Léopold Simar, 2007. "Conditional nonparametric frontier models for convex and nonconvex technologies: a unifying approach," Journal of Productivity Analysis, Springer, vol. 28(1), pages 13-32, October.
    33. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    34. D. Shin & D. Johnson, 1978. "Avowed happiness as an overall assessment of the quality of life," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 5(1), pages 475-492, March.
    35. Doumpos, Michael & Hasan, Iftekhar & Pasiouras, Fotios, 2017. "Bank overall financial strength: Islamic versus conventional banks," Economic Modelling, Elsevier, vol. 64(C), pages 513-523.
    36. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    37. Michael Freudenberg, 2003. "Composite Indicators of Country Performance: A Critical Assessment," OECD Science, Technology and Industry Working Papers 2003/16, OECD Publishing.
    38. Gilboa, Itzhak & Schmeidler, David, 1989. "Maxmin expected utility with non-unique prior," Journal of Mathematical Economics, Elsevier, vol. 18(2), pages 141-153, April.
    39. Atkinson, Anthony B., 1970. "On the measurement of inequality," Journal of Economic Theory, Elsevier, vol. 2(3), pages 244-263, September.
    40. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    41. Douglas W. Blackburn & Andrey D. Ukhov, 2013. "Individual vs. Aggregate Preferences: The Case of a Small Fish in a Big Pond," Management Science, INFORMS, vol. 59(2), pages 470-484, August.
    42. Daouia, Abdelaati & Simar, Leopold, 2007. "Nonparametric efficiency analysis: A multivariate conditional quantile approach," Journal of Econometrics, Elsevier, vol. 140(2), pages 375-400, October.
    43. Douglas M. Hawkins, 1980. "Critical Values for Identifying Outliers," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 29(1), pages 95-96, March.
    44. Corrente, Salvatore & Figueira, José Rui & Greco, Salvatore, 2014. "The SMAA-PROMETHEE method," European Journal of Operational Research, Elsevier, vol. 239(2), pages 514-522.
    45. Cazals, Catherine & Florens, Jean-Pierre & Simar, Leopold, 2002. "Nonparametric frontier estimation: a robust approach," Journal of Econometrics, Elsevier, vol. 106(1), pages 1-25, January.
    46. Giarlotta, Alfio & Greco, Salvatore, 2013. "Necessary and possible preference structures," Journal of Mathematical Economics, Elsevier, vol. 49(2), pages 163-172.
    47. Joseph E. Stiglitz & Amartya Sen & Jean-Paul Fitoussi, 2009. "The measurement of economic performance and social progress revisited," Documents de Travail de l'OFCE 2009-33, Observatoire Francais des Conjonctures Economiques (OFCE).
    48. Michael Doumpos & Chrysovalantis Gaganis & Fotios Pasiouras, 2016. "Bank Diversification and Overall Financial Strength: International Evidence," Working Papers 1602, University of Crete, Department of Economics.
    49. Kunsch, Pierre L. & Ishizaka, Alessio, 2018. "Multiple-criteria performance ranking based on profile distributions: An application to university research evaluations," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 154(C), pages 48-64.
    50. Frederik Booysen, 2002. "An Overview and Evaluation of Composite Indices of Development," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 59(2), pages 115-151, August.
    51. Matteo Mazziotta & Adriano Pareto, 2016. "On a Generalized Non-compensatory Composite Index for Measuring Socio-economic Phenomena," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 127(3), pages 983-1003, July.
    52. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    53. Salvatore Greco & Alessio Ishizaka & Benedetto Matarazzo & Gianpiero Torrisi, 2018. "Stochastic multi-attribute acceptability analysis (SMAA): an application to the ranking of Italian regions," Regional Studies, Taylor & Francis Journals, vol. 52(4), pages 585-600, April.
    54. Andrew Sharpe, 2004. "Literature Review of Frameworks for Macro-indicators," CSLS Research Reports 2004-03, Centre for the Study of Living Standards.
    55. Shyamal Chowdhury & Lyn Squire, 2006. "Setting weights for aggregate indices: An application to the commitment to development index and human development index," Journal of Development Studies, Taylor & Francis Journals, vol. 42(5), pages 761-771.
    56. Evren, Özgür & Ok, Efe A., 2011. "On the multi-utility representation of preference relations," Journal of Mathematical Economics, Elsevier, vol. 47(4-5), pages 554-563.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "The Ordinal Input for Cardinal Output Approach of Non-compensatory Composite Indicators: The PROMETHEE Scoring Method," MPRA Paper 95816, University Library of Munich, Germany.
    2. Ana Garcia-Bernabeu & Adolfo Hilario-Caballero & David Pla-Santamaria & Francisco Salas-Molina, 2020. "A Process Oriented MCDM Approach to Construct a Circular Economy Composite Index," Sustainability, MDPI, Open Access Journal, vol. 12(2), pages 1-14, January.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:278:y:2019:i:3:p:942-960. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Dana Niculescu). General contact details of provider: http://www.elsevier.com/locate/eor .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.