IDEAS home Printed from https://ideas.repec.org/a/spr/jbecon/v89y2019i1d10.1007_s11573-018-0902-z.html
   My bibliography  Save this article

Building composite indicators using multicriteria methods: a review

Author

Listed:
  • Samira El Gibari

    (Universidad de Málaga)

  • Trinidad Gómez

    (Universidad de Málaga)

  • Francisco Ruiz

    (Universidad de Málaga)

Abstract

Composite indicators are increasingly recognised as a useful tool in policy analysis and public communication. They provide simple comparisons of units that can be used to illustrate the complexity of our dynamic environment in wide-ranging fields, such as competitiveness, governance, environment, press, development, peacefulness, tourism, economy, universities, etc. Their construction has been dealt with from several angles. Some authors claim that MCDM techniques are highly suitable in multidimensional frameworks when aggregating single indicators into a composite one, since this process involves making choices when combining criteria of different natures, and it requires a number of steps in which decisions must be made. In this paper, we conduct a literature review of papers published after 2002 in leading international journals indexed in a recognised database (JCR), in order to identify the different MCDM methods used for aggregating single indicators into composite ones. They have been classified in five categories: the elementary methods, the value and utility based methods, the outranking relation approach, the data envelopment analysis based methods and the distance functions based methods. In general, our review has shown a clear tendency towards an increasing number of papers that use MCDM methods to construct composite indicators since 2014.

Suggested Citation

  • Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
  • Handle: RePEc:spr:jbecon:v:89:y:2019:i:1:d:10.1007_s11573-018-0902-z
    DOI: 10.1007/s11573-018-0902-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11573-018-0902-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11573-018-0902-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Tarja Joro & Pekka Korhonen & Jyrki Wallenius, 1998. "Structural Comparison of Data Envelopment Analysis and Multiple Objective Linear Programming," Management Science, INFORMS, vol. 44(7), pages 962-970, July.
    3. Li, Wenhua & Yu, Suihuai & Pei, Huining & Zhao, Chuan & Tian, Baozhen, 2017. "A hybrid approach based on fuzzy AHP and 2-tuple fuzzy linguistic method for evaluation in-flight service quality," Journal of Air Transport Management, Elsevier, vol. 60(C), pages 49-64.
    4. Honghao Zhang & Yong Peng & Guangdong Tian & Danqi Wang & Pengpeng Xie, 2017. "Green material selection for sustainability: A hybrid MCDM approach," PLOS ONE, Public Library of Science, vol. 12(5), pages 1-26, May.
    5. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    6. Giuseppe Munda, 2005. "“Measuring Sustainability”: A Multi-Criterion Framework," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 7(1), pages 117-134, January.
    7. van Calker, K.J. & Berentsen, P.B.M. & Romero, C. & Giesen, G.W.J. & Huirne, R.B.M., 2006. "Development and application of a multi-attribute sustainability function for Dutch dairy farming systems," Ecological Economics, Elsevier, vol. 57(4), pages 640-658, June.
    8. Hernandez-Perdomo, Elvis A. & Mun, Johnathan & Rocco S., Claudio M., 2017. "Active management in state-owned energy companies: Integrating a real options approach into multicriteria analysis to make companies sustainable," Applied Energy, Elsevier, vol. 195(C), pages 487-502.
    9. Dobos, Imre & Vörösmarty, Gyöngyi, 2014. "Green supplier selection and evaluation using DEA-type composite indicators," International Journal of Production Economics, Elsevier, vol. 157(C), pages 273-278.
    10. Kao, Chiang & Hung, Hsi-Tai, 2008. "Efficiency analysis of university departments: An empirical study," Omega, Elsevier, vol. 36(4), pages 653-664, August.
    11. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    12. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    13. P. L. Yu, 1973. "A Class of Solutions for Group Decision Problems," Management Science, INFORMS, vol. 19(8), pages 936-946, April.
    14. Laurens Cherchye & & Timo Kuosmanen, 2002. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Others 0210001, University Library of Munich, Germany, revised 04 Dec 2002.
    15. Fare, Rolf & Zelenyuk, Valentin, 2003. "On aggregate Farrell efficiencies," European Journal of Operational Research, Elsevier, vol. 146(3), pages 615-620, May.
    16. Verbunt, Pim & Rogge, Nicky, 2018. "Geometric composite indicators with compromise Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 264(1), pages 388-401.
    17. Zeng, Shouzhen & Streimikiene, Dalia & Baležentis, Tomas, 2017. "Review of and comparative assessment of energy security in Baltic States," Renewable and Sustainable Energy Reviews, Elsevier, vol. 76(C), pages 185-192.
    18. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    19. Wang, Delu & Wan, Kaidi & Song, Xuefeng, 2018. "Coal miners’ livelihood vulnerability to economic shock: Multi-criteria assessment and policy implications," Energy Policy, Elsevier, vol. 114(C), pages 301-314.
    20. Navarro Jurado, E. & Tejada Tejada, M. & Almeida García, F. & Cabello González, J. & Cortés Macías, R. & Delgado Peña, J. & Fernández Gutiérrez, F. & Gutiérrez Fernández, G. & Luque Gallego, M. & Málv, 2012. "Carrying capacity assessment for tourist destinations. Methodology for the creation of synthetic indicators applied in a coastal area," Tourism Management, Elsevier, vol. 33(6), pages 1337-1346.
    21. F Ruiz & J M Cabello & M Luque, 2011. "An application of reference point techniques to the calculation of synthetic sustainability indicators," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(1), pages 189-197, January.
    22. Morais, Paulo & Camanho, Ana S., 2011. "Evaluation of performance of European cities with the aim to promote quality of life improvements," Omega, Elsevier, vol. 39(4), pages 398-409, August.
    23. Carrillo, Marianela & Jorge, Jesús M., 2017. "Multidimensional Analysis of Regional Tourism Sustainability in Spain," Ecological Economics, Elsevier, vol. 140(C), pages 89-98.
    24. Institute for Economics and Peace, 2017. "Global Peace Index 2017," Working Papers id:11991, eSocialSciences.
    25. Jean-Charles Billaut & Denis Bouyssou & Philippe Vincke, 2010. "Should you believe in the Shanghai ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(1), pages 237-263, July.
    26. Cliville, Vincent & Berrah, Lamia & Mauris, Gilles, 2007. "Quantitative expression and aggregation of performance measurements based on the MACBETH multi-criteria method," International Journal of Production Economics, Elsevier, vol. 105(1), pages 171-189, January.
    27. Qingyong Wang & Hong-Ning Dai & Hao Wang, 2017. "A Smart MCDM Framework to Evaluate the Impact of Air Pollution on City Sustainability: A Case Study from China," Sustainability, MDPI, vol. 9(6), pages 1-17, May.
    28. Grigoroudis, E. & Orfanoudaki, E. & Zopounidis, C., 2012. "Strategic performance measurement in a healthcare organisation: A multiple criteria approach based on balanced scorecard," Omega, Elsevier, vol. 40(1), pages 104-119, January.
    29. Walter W. Kropp & James K. Lein, 2012. "Assessing the Geographic Expression of Urban Sustainability: A Scenario Based Approach Incorporating Spatial Multicriteria Decision Analysis," Sustainability, MDPI, vol. 4(9), pages 1-18, September.
    30. repec:dau:papers:123456789/2947 is not listed on IDEAS
    31. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    32. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    33. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    34. Michael Freudenberg, 2003. "Composite Indicators of Country Performance: A Critical Assessment," OECD Science, Technology and Industry Working Papers 2003/16, OECD Publishing.
    35. Krajnc, Damjan & Glavic, Peter, 2005. "How to compare companies on relevant dimensions of sustainability," Ecological Economics, Elsevier, vol. 55(4), pages 551-563, December.
    36. Papapostolou, Aikaterini & Karakosta, Charikleia & Nikas, Alexandros & Psarras, John, 2017. "Exploring opportunities and risks for RES-E deployment under Cooperation Mechanisms between EU and Western Balkans: A multi-criteria assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 80(C), pages 519-530.
    37. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    38. Diaz-Balteiro, L & González-Pachón, J. & Romero, C., 2017. "Measuring systems sustainability with multi-criteria methods: A critical review," European Journal of Operational Research, Elsevier, vol. 258(2), pages 607-616.
    39. Pilar Murias & José Miguel & David Rodríguez, 2008. "A Composite Indicator for University Quality Assesment: The Case of Spanish Higher Education System," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 89(1), pages 129-146, October.
    40. Giuseppe Munda, 2008. "Social Multi-Criteria Evaluation for a Sustainable Economy," Springer Books, Springer, number 978-3-540-73703-2, September.
    41. Gomez-Limon, Jose Antonio & Riesgo, Laura, 2008. "Alternative Approaches On Constructing A Composite Indicator To Measure Agricultural Sustainability," 107th Seminar, January 30-February 1, 2008, Sevilla, Spain 6489, European Association of Agricultural Economists.
    42. Wurtenberger, Laura & Koellner, Thomas & Binder, Claudia R., 2006. "Virtual land use and agricultural trade: Estimating environmental and socio-economic impacts," Ecological Economics, Elsevier, vol. 57(4), pages 679-697, June.
    43. Diaz-Balteiro, Luis & Romero, Carlos, 2004. "In search of a natural systems sustainability index," Ecological Economics, Elsevier, vol. 49(3), pages 401-405, July.
    44. Boggia, Antonio & Massei, Gianluca & Pace, Elaine & Rocchi, Lucia & Paolotti, Luisa & Attard, Maria, 2018. "Spatial multicriteria analysis for sustainability assessment: A new model for decision making," Land Use Policy, Elsevier, vol. 71(C), pages 281-292.
    45. Madeira, Armando Gonçalves & Cardoso, Moacyr Machado & Belderrain, Mischel Carmen Neyra & Correia, Anderson Ribeiro & Schwanz, Silvia Helena, 2012. "Multicriteria and multivariate analysis for port performance evaluation," International Journal of Production Economics, Elsevier, vol. 140(1), pages 450-456.
    46. Luisa Martí & Juan Carlos Martín & Rosa Puertas, 2017. "A DEA-logistics performance index," Journal of Applied Economics, Universidad del CEMA, vol. 20, pages 169-192, May.
    47. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    48. Cherchye, Laurens & Knox Lovell, C.A. & Moesen, Wim & Van Puyenbroeck, Tom, 2007. "One market, one number? A composite indicator assessment of EU internal market dynamics," European Economic Review, Elsevier, vol. 51(3), pages 749-779, April.
    49. Blancas, Francisco J. & Caballero, Rafael & González, Mercedes & Lozano-Oyola, Macarena & Pérez, Fátima, 2010. "Goal programming synthetic indicators: An application for sustainable tourism in Andalusian coastal counties," Ecological Economics, Elsevier, vol. 69(11), pages 2158-2172, September.
    50. Zhou, P. & Ang, B.W. & Poh, K.L., 2006. "Comparing aggregating methods for constructing the composite environmental index: An objective measure," Ecological Economics, Elsevier, vol. 59(3), pages 305-311, September.
    51. Laurens Cherchye & Wim Moesen & Tom Van Puyenbroeck, 2004. "Legitimately Diverse, yet Comparable: On Synthesizing Social Inclusion Performance in the EU," Journal of Common Market Studies, Wiley Blackwell, vol. 42(5), pages 919-955, December.
    52. Kao, Chiang & Hung, Hsi-Tai, 2007. "Management performance: An empirical study of the manufacturing companies in Taiwan," Omega, Elsevier, vol. 35(2), pages 152-160, April.
    53. Torres Sibille, Ana del Carmen & Cloquell-Ballester, Víctor-Andrés & Cloquell-Ballester, Vicente-Agustín & Darton, Richard, 2009. "Development and validation of a multicriteria indicator for the assessment of objective aesthetic impact of wind farms," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(1), pages 40-66, January.
    54. Despotis, D.K., 2005. "Measuring human development via data envelopment analysis: the case of Asia and the Pacific," Omega, Elsevier, vol. 33(5), pages 385-390, October.
    55. Bertrand Mareschal & Jean Pierre Brans & Philippe Vincke, 1986. "How to select and how to rank projects: the Prométhée method," ULB Institutional Repository 2013/9307, ULB -- Universite Libre de Bruxelles.
    56. Attardi, Raffaele & Cerreta, Maria & Sannicandro, Valentina & Torre, Carmelo Maria, 2018. "Non-compensatory composite indicators for the evaluation of urban planning policy: The Land-Use Policy Efficiency Index (LUPEI)," European Journal of Operational Research, Elsevier, vol. 264(2), pages 491-507.
    57. Brans, J. P. & Vincke, Ph. & Mareschal, B., 1986. "How to select and how to rank projects: The method," European Journal of Operational Research, Elsevier, vol. 24(2), pages 228-238, February.
    58. Gianluigi De Mare & Maria Fiorella Granata & Antonio Nesticò, 2015. "Weak and Strong Compensation for the Prioritization of Public Investments: Multidimensional Analysis for Pools," Sustainability, MDPI, vol. 7(12), pages 1-17, December.
    59. Hajkowicz, Stefan, 2006. "Multi-attributed environmental index construction," Ecological Economics, Elsevier, vol. 57(1), pages 122-139, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Franciely Velozo Aragão & Daiane Maria de Genaro Chiroli & Fernanda Cavicchioli Zola & Emanuely Velozo Aragão & Luis Henrique Nogueira Marinho & Ana Lidia Cascales Correa & João Carlos Colmenero, 2023. "Smart Cities Maturity Model—A Multicriteria Approach," Sustainability, MDPI, vol. 15(8), pages 1-20, April.
    2. Ruiz, Francisco & El Gibari, Samira & Cabello, José M. & Gómez, Trinidad, 2020. "MRP-WSCI: Multiple reference point based weak and strong composite indicators," Omega, Elsevier, vol. 95(C).
    3. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    4. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    5. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    6. Zhang, L.P. & Zhou, P., 2018. "A non-compensatory composite indicator approach to assessing low-carbon performance," European Journal of Operational Research, Elsevier, vol. 270(1), pages 352-361.
    7. P. Zhou & B. Ang, 2009. "Comparing MCDA Aggregation Methods in Constructing Composite Indicators Using the Shannon-Spearman Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(1), pages 83-96, October.
    8. Ju, Keyi & Su, Bin & Zhou, Dequn & Zhou, P. & Zhang, Yuqiang, 2015. "Oil price crisis response: Capability assessment and key indicator identification," Energy, Elsevier, vol. 93(P2), pages 1353-1360.
    9. Diaz-Balteiro, L & González-Pachón, J. & Romero, C., 2017. "Measuring systems sustainability with multi-criteria methods: A critical review," European Journal of Operational Research, Elsevier, vol. 258(2), pages 607-616.
    10. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    11. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "The Ordinal Input for Cardinal Output Approach of Non-compensatory Composite Indicators: The PROMETHEE Scoring Method," MPRA Paper 95816, University Library of Munich, Germany.
    12. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2021. "The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method," European Journal of Operational Research, Elsevier, vol. 288(1), pages 225-246.
    13. Rogge, Nicky, 2018. "Composite indicators as generalized benefit-of-the-doubt weighted averages," European Journal of Operational Research, Elsevier, vol. 267(1), pages 381-392.
    14. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    15. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    16. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    17. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    18. Lozano-Oyola, Macarena & Contreras, Ignacio & Blancas, Francisco Javier, 2019. "An Operational Non-compensatory Composite Indicator: Measuring Sustainable Tourism in Andalusian Urban Destinations," Ecological Economics, Elsevier, vol. 159(C), pages 1-10.
    19. Ana Garcia-Bernabeu & Adolfo Hilario-Caballero, 2021. "Monitoring multidimensional phenomena with a multicriteria composite performance interval approach," Papers 2107.08393, arXiv.org.
    20. L. P. Zhang & P. Zhou, 2019. "Reassessment of global climate risk: non-compensatory or compensatory?," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 95(1), pages 271-287, January.

    More about this item

    Keywords

    Composite/synthetic indicators; Multicriteria decision making; Multicriteria analysis; Indicator framework; Aggregation; Compensation;
    All these keywords.

    JEL classification:

    • C02 - Mathematical and Quantitative Methods - - General - - - Mathematical Economics
    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • Q01 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - General - - - Sustainable Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jbecon:v:89:y:2019:i:1:d:10.1007_s11573-018-0902-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.