IDEAS home Printed from https://ideas.repec.org/a/eee/jomega/v95y2020ics0305048318310375.html
   My bibliography  Save this article

MRP-WSCI: Multiple reference point based weak and strong composite indicators

Author

Listed:
  • Ruiz, Francisco
  • El Gibari, Samira
  • Cabello, José M.
  • Gómez, Trinidad

Abstract

The construction of composite indicators is becoming an increasingly important way of managing great amounts of information obtained from multiple single indicators. Obviously, the aggregation of several indicators in a single synthetic measure always implies some loss of information on the way. For this reason, this aggregation must be done in the most informative possible way, so that the results obtained can be easily interpreted, and in an efficient way, so that the information contained in the composite indicator is maximal. In this paper, we propose a novel methodology based on the multicriteria reference point scheme. The decision maker can establish any number of reference levels for each indicator, and the final outcome can be interpreted in terms of the position with respect to these levels. Besides, two different aggregations are proposed: the weak indicator, allowing for full compensation among the single indicators, and the strong indicator, not allowing for any compensation. The joint visualization of both composite indicators provides valuable information that may be unnoticed using other existing approaches. The approach is illustrated using an example based on the EU-Regional Social Progress Index (EU-SPI).

Suggested Citation

  • Ruiz, Francisco & El Gibari, Samira & Cabello, José M. & Gómez, Trinidad, 2020. "MRP-WSCI: Multiple reference point based weak and strong composite indicators," Omega, Elsevier, vol. 95(C).
  • Handle: RePEc:eee:jomega:v:95:y:2020:i:c:s0305048318310375
    DOI: 10.1016/j.omega.2019.04.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0305048318310375
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.omega.2019.04.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    3. Cernat, Lucian & Gourdon, Julien, 2012. "Paths to success: Benchmarking cross-country sustainable tourism," Tourism Management, Elsevier, vol. 33(5), pages 1044-1056.
    4. Fusco, Elisa & Vidoli, Francesco & Sahoo, Biresh K., 2018. "Spatial heterogeneity in composite indicator: A methodological proposal," Omega, Elsevier, vol. 77(C), pages 1-14.
    5. Cabello, J.M. & Ruiz, F. & Pérez-Gladish, B. & Méndez-Rodríguez, P., 2014. "Synthetic indicators of mutual funds’ environmental responsibility: An application of the Reference Point Method," European Journal of Operational Research, Elsevier, vol. 236(1), pages 313-325.
    6. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    7. Jollands, Nigel & Lermit, Jonathan & Patterson, Murray, 2004. "Aggregate eco-efficiency indices for New Zealand – a Principal Components Analysis," 2004 Conference, June 25-26, 2004, Blenheim, New Zealand 97773, New Zealand Agricultural and Resource Economics Society.
    8. Navarro Jurado, E. & Tejada Tejada, M. & Almeida García, F. & Cabello González, J. & Cortés Macías, R. & Delgado Peña, J. & Fernández Gutiérrez, F. & Gutiérrez Fernández, G. & Luque Gallego, M. & Málv, 2012. "Carrying capacity assessment for tourist destinations. Methodology for the creation of synthetic indicators applied in a coastal area," Tourism Management, Elsevier, vol. 33(6), pages 1337-1346.
    9. F Ruiz & J M Cabello & M Luque, 2011. "An application of reference point techniques to the calculation of synthetic sustainability indicators," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(1), pages 189-197, January.
    10. Carrillo, Marianela & Jorge, Jesús M., 2017. "Multidimensional Analysis of Regional Tourism Sustainability in Spain," Ecological Economics, Elsevier, vol. 140(C), pages 89-98.
    11. Pasquale De Muro & Matteo Mazziotta & Adriano Pareto, 2011. "Composite Indices of Development and Poverty: An Application to MDGs," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 104(1), pages 1-18, October.
    12. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    13. Krajnc, Damjan & Glavic, Peter, 2005. "How to compare companies on relevant dimensions of sustainability," Ecological Economics, Elsevier, vol. 55(4), pages 551-563, December.
    14. Diaz-Balteiro, L & González-Pachón, J. & Romero, C., 2017. "Measuring systems sustainability with multi-criteria methods: A critical review," European Journal of Operational Research, Elsevier, vol. 258(2), pages 607-616.
    15. Giuseppe Munda, 2008. "Social Multi-Criteria Evaluation for a Sustainable Economy," Springer Books, Springer, number 978-3-540-73703-2, September.
    16. Francesco Vidoli & Elisa Fusco & Claudio Mazziotta, 2015. "Non-compensability in Composite Indicators: A Robust Directional Frontier Method," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 122(3), pages 635-652, July.
    17. M C A Silva Portela & E Thanassoulis & G Simpson, 2004. "Negative data in DEA: a directional distance approach applied to bank branches," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(10), pages 1111-1121, October.
    18. Benito Bonito, Mónica & Romera Ayllón, María Rosario, 2011. "Improving quality assessment of composite indicators in university rankings: a case study of French and German universities of excellence," DES - Working Papers. Statistics and Econometrics. WS ws112015, Universidad Carlos III de Madrid. Departamento de Estadística.
    19. Yoram Wind & Thomas L. Saaty, 1980. "Marketing Applications of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 26(7), pages 641-658, July.
    20. Blancas, Francisco J. & Caballero, Rafael & González, Mercedes & Lozano-Oyola, Macarena & Pérez, Fátima, 2010. "Goal programming synthetic indicators: An application for sustainable tourism in Andalusian coastal counties," Ecological Economics, Elsevier, vol. 69(11), pages 2158-2172, September.
    21. Luzzati, T. & Gucciardi, G., 2015. "A non-simplistic approach to composite indicators and rankings: an illustration by comparing the sustainability of the EU Countries," Ecological Economics, Elsevier, vol. 113(C), pages 25-38.
    22. Zhou, P. & Ang, B.W. & Poh, K.L., 2006. "Comparing aggregating methods for constructing the composite environmental index: An objective measure," Ecological Economics, Elsevier, vol. 59(3), pages 305-311, September.
    23. Kao, Chiang & Hung, Hsi-Tai, 2007. "Management performance: An empirical study of the manufacturing companies in Taiwan," Omega, Elsevier, vol. 35(2), pages 152-160, April.
    24. Bertrand Mareschal & Jean Pierre Brans & Philippe Vincke, 1986. "How to select and how to rank projects: the Prométhée method," ULB Institutional Repository 2013/9307, ULB -- Universite Libre de Bruxelles.
    25. Attardi, Raffaele & Cerreta, Maria & Sannicandro, Valentina & Torre, Carmelo Maria, 2018. "Non-compensatory composite indicators for the evaluation of urban planning policy: The Land-Use Policy Efficiency Index (LUPEI)," European Journal of Operational Research, Elsevier, vol. 264(2), pages 491-507.
    26. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    27. Brans, J. P. & Vincke, Ph. & Mareschal, B., 1986. "How to select and how to rank projects: The method," European Journal of Operational Research, Elsevier, vol. 24(2), pages 228-238, February.
    28. M. Benito & R. Romera, 2011. "Improving quality assessment of composite indicators in university rankings: a case study of French and German universities of excellence," Scientometrics, Springer;Akadémiai Kiadó, vol. 89(1), pages 153-176, October.
    29. Liu, Jiapeng & Liao, Xiuwu & Zhao, Wenhong & Yang, Na, 2016. "A classification approach based on the outranking model for multiple criteria ABC analysis," Omega, Elsevier, vol. 61(C), pages 19-34.
    30. El Gibari, Samira & Gómez, Trinidad & Ruiz, Francisco, 2018. "Evaluating university performance using reference point based composite indicators," Journal of Informetrics, Elsevier, vol. 12(4), pages 1235-1250.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2022. "Combining reference point based composite indicators with data envelopment analysis: application to the assessment of universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4363-4395, August.
    2. José Manuel Cabello & Francisco Ruiz & Blanca Pérez-Gladish, 2021. "An Alternative Aggregation Process for Composite Indexes: An Application to the Heritage Foundation Economic Freedom Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 153(2), pages 443-467, January.
    3. José Antonio, Palomero-González & Vicent, Almenar-Llongo & Ramón, Fuentes-Pascual, 2022. "A composite indicator index as a proxy for measuring the quality of water supply as perceived by users for urban water services," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    4. Francisco Ruiz & José Manuel Cabello, 2021. "MRP-PCI: A Multiple Reference Point Based Partially Compensatory Composite Indicator for Sustainability Assessment," Sustainability, MDPI, vol. 13(3), pages 1-19, January.
    5. Flavio Comim, 2021. "A Poset-Generalizability Method for Human Development Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 158(3), pages 1179-1198, December.
    6. Samira El Gibari & Carmen Perez-Esparrells & Trinidad Gomez & Francisco Ruiz, 2021. "Analyzing the Impact of Spanish University Funding Policies on the Evolution of Their Performance: A Multi-Criteria Approach," Mathematics, MDPI, vol. 9(14), pages 1-34, July.
    7. Amelia Bilbao-Terol & Mar Arenas-Parra & Raquel Quiroga-García & Celia Bilbao-Terol, 2022. "An extended best–worst multiple reference point method: application in the assessment of non-life insurance companies," Operational Research, Springer, vol. 22(5), pages 5323-5362, November.
    8. Ewa Roszkowska & Bartłomiej Jefmański, 2021. "Interval-Valued Intuitionistic Fuzzy Synthetic Measure (I-VIFSM) Based on Hellwig’s Approach in the Analysis of Survey Data," Mathematics, MDPI, vol. 9(3), pages 1-17, January.
    9. de Castro-Pardo, Mónica & Cabello, José Manuel & Martín, José María & Ruiz, Francisco, 2023. "A multi reference point based index to assess and monitor European water policies from a sustainability approach," Socio-Economic Planning Sciences, Elsevier, vol. 89(C).
    10. E. Ricciolini & L. Rocchi & M. Cardinali & L. Paolotti & F. Ruiz & J. M. Cabello & A. Boggia, 2022. "Assessing Progress Towards SDGs Implementation Using Multiple Reference Point Based Multicriteria Methods: The Case Study of the European Countries," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 162(3), pages 1233-1260, August.
    11. Andrea De Montis & Vittorio Serra & Amedeo Ganciu & Antonio Ledda, 2020. "Assessing Landscape Fragmentation: A Composite Indicator," Sustainability, MDPI, vol. 12(22), pages 1-23, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    2. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    3. Lozano-Oyola, Macarena & Contreras, Ignacio & Blancas, Francisco Javier, 2019. "An Operational Non-compensatory Composite Indicator: Measuring Sustainable Tourism in Andalusian Urban Destinations," Ecological Economics, Elsevier, vol. 159(C), pages 1-10.
    4. Ana Garcia-Bernabeu & Adolfo Hilario-Caballero, 2021. "Monitoring multidimensional phenomena with a multicriteria composite performance interval approach," Papers 2107.08393, arXiv.org.
    5. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    6. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    7. Diaz-Balteiro, L & González-Pachón, J. & Romero, C., 2017. "Measuring systems sustainability with multi-criteria methods: A critical review," European Journal of Operational Research, Elsevier, vol. 258(2), pages 607-616.
    8. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    9. Zhang, L.P. & Zhou, P., 2018. "A non-compensatory composite indicator approach to assessing low-carbon performance," European Journal of Operational Research, Elsevier, vol. 270(1), pages 352-361.
    10. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "The Ordinal Input for Cardinal Output Approach of Non-compensatory Composite Indicators: The PROMETHEE Scoring Method," MPRA Paper 95816, University Library of Munich, Germany.
    11. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2021. "The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method," European Journal of Operational Research, Elsevier, vol. 288(1), pages 225-246.
    12. José Manuel Cabello & Francisco Ruiz & Blanca Pérez-Gladish, 2021. "An Alternative Aggregation Process for Composite Indexes: An Application to the Heritage Foundation Economic Freedom Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 153(2), pages 443-467, January.
    13. Marianela Carrillo, 2022. "Measuring Progress towards Sustainability in the European Union within the 2030 Agenda Framework," Mathematics, MDPI, vol. 10(12), pages 1-23, June.
    14. Ana Garcia-Bernabeu & José Manuel Cabello & Francisco Ruiz, 2020. "A Multi-Criteria Reference Point Based Approach for Assessing Regional Innovation Performance in Spain," Mathematics, MDPI, vol. 8(5), pages 1-21, May.
    15. M. M. Segovia-González & I. Contreras, 2023. "A Composite Indicator to Compare the Performance of Male and Female Students in Educational Systems," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 165(1), pages 181-212, January.
    16. Denys Yemshanov & Frank H. Koch & Yakov Ben‐Haim & Marla Downing & Frank Sapio & Marty Siltanen, 2013. "A New Multicriteria Risk Mapping Approach Based on a Multiattribute Frontier Concept," Risk Analysis, John Wiley & Sons, vol. 33(9), pages 1694-1709, September.
    17. Fusco, Elisa, 2023. "Potential improvements approach in composite indicators construction: The Multi-directional Benefit of the Doubt model," Socio-Economic Planning Sciences, Elsevier, vol. 85(C).
    18. Tommaso Luzzati & Bruno Cheli & Gianluca Gucciardi, 2017. "Communicating the uncertainty of synthetic indicators: a reassessment of the HDI ranking," Discussion Papers 2017/228, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.
    19. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    20. Giuliano Resce & Fritz Schiltz, 2021. "Sustainable Development in Europe: A Multicriteria Decision Analysis," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(2), pages 509-529, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jomega:v:95:y:2020:i:c:s0305048318310375. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/375/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.