IDEAS home Printed from https://ideas.repec.org/a/spr/endesu/v27y2025i3d10.1007_s10668-023-04116-w.html
   My bibliography  Save this article

Building composite indicators for the territorial quality of life assessment in European regions: combining data reduction and alternative weighting techniques

Author

Listed:
  • Eda Ustaoglu

    (Abdullah Gul University)

  • Gloria Ortega Lopez

    (University of Almeria)

  • Alejandro Gutierrez-Alcoba

    (University of Edinburgh)

Abstract

Development of composite indicators is a challenging task given that sustainability indices are strongly dependent on how the sub-indicators are weighted. This is because relative indicator weights may significantly differ based on the chosen weighting methods used in the analysis. There is hardly any study that has paid attention to this issue so far. Therefore, this paper aims to fill this gap in the literature by searching the robustness of selected weighting methods, i.e. entropy-weight (EW), principal component analysis (PCA), machine learning approaches (random forest-RF), regression analysis (RA) and benefit-of-the-doubt (BOD) when constructing a composite indicator. To research the current sustainability performance of European regions, the present study focuses on the Territorial Quality of Life Index—initially proposed by the ESPON Programme—that are aligned with the specific targets of the Sustainable Development Goals of the 2030 Agenda. The methods to construct composite indicators include stages of data preparation (including the estimation of missing values with random forest method), normalization, statistical transformation of raw data, reduction of indicators in order to ease public communication (using the PCA method) and data interpretation, weighting of the sub-indicators using EW, PCA, RF, RA and BOD methods and their linear weighted aggregation, and checking for robustness and sensitivity. The results suggest that there are significant differences in the rank and spatial distribution of composite indicators based on the use of different weighting methods considered in the analysis. The results from sensitivity analysis support the robustness of entropy-weight method among others. The methodology used in the current analysis can be adapted to other study areas and regions internationally. The findings showed that Eastern European countries and some Mediterranean countries have relatively lower index values compared to other European regions; therefore, policy and planning actions are needed covering these regions specifically.

Suggested Citation

  • Eda Ustaoglu & Gloria Ortega Lopez & Alejandro Gutierrez-Alcoba, 2025. "Building composite indicators for the territorial quality of life assessment in European regions: combining data reduction and alternative weighting techniques," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 27(3), pages 6025-6063, March.
  • Handle: RePEc:spr:endesu:v:27:y:2025:i:3:d:10.1007_s10668-023-04116-w
    DOI: 10.1007/s10668-023-04116-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10668-023-04116-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s10668-023-04116-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Qingsong Wang & Xueliang Yuan & Jian Zhang & Yun Gao & Jinglan Hong & Jian Zuo & Wei Liu, 2015. "Assessment of the Sustainable Development Capacity with the Entropy Weight Coefficient Method," Sustainability, MDPI, vol. 7(10), pages 1-22, October.
    3. Douglas Gollin & Remi Jedwab & Dietrich Vollrath, 2016. "Urbanization with and without industrialization," Journal of Economic Growth, Springer, vol. 21(1), pages 35-70, March.
    4. Van de Kerk, Geurt & Manuel, Arthur R., 2008. "A comprehensive index for a sustainable society: The SSI -- the Sustainable Society Index," Ecological Economics, Elsevier, vol. 66(2-3), pages 228-242, June.
    5. repec:ers:journl:v:xxiv:y:2021:i:special3:p:402-418 is not listed on IDEAS
    6. Cai, Zhaoyang & Liu, Qing & Cao, Shixiong, 2020. "Real estate supports rapid development of China's urbanization," Land Use Policy, Elsevier, vol. 95(C).
    7. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    8. Zhen Yang & Jun Lei & Jian-Gang Li, 2019. "Identifying the Determinants of Urbanization in Prefecture-Level Cities in China: A Quantitative Analysis Based on Spatial Production Theory," Sustainability, MDPI, vol. 11(4), pages 1-18, February.
    9. Laurens Cherchye & & Timo Kuosmanen, 2002. "Benchmarking Sustainable Development: A Synthetic Meta-index Approach," Others 0210001, University Library of Munich, Germany, revised 04 Dec 2002.
    10. D'Adamo, Idiano & Falcone, Pasquale Marcello & Morone, Piergiuseppe, 2020. "A New Socio-economic Indicator to Measure the Performance of Bioeconomy Sectors in Europe," Ecological Economics, Elsevier, vol. 176(C).
    11. Szopik-Depczyńska, Katarzyna & Kędzierska-Szczepaniak, Angelika & Szczepaniak, Krzysztof & Cheba, Katarzyna & Gajda, Waldemar & Ioppolo, Giuseppe, 2018. "Innovation in sustainable development: an investigation of the EU context using 2030 agenda indicators," Land Use Policy, Elsevier, vol. 79(C), pages 251-262.
    12. Blancas, Francisco J. & Caballero, Rafael & González, Mercedes & Lozano-Oyola, Macarena & Pérez, Fátima, 2010. "Goal programming synthetic indicators: An application for sustainable tourism in Andalusian coastal counties," Ecological Economics, Elsevier, vol. 69(11), pages 2158-2172, September.
    13. Nicholas Charron & Victor Lapuente & Paola Annoni, 2019. "Measuring quality of government in EU regions across space and time," Papers in Regional Science, Wiley Blackwell, vol. 98(5), pages 1925-1953, October.
    14. Constantin Belu, 2009. "Ranking corporations based on sustainable and socially responsible practices. A data envelopment analysis (DEA) approach," Sustainable Development, John Wiley & Sons, Ltd., vol. 17(4), pages 257-268.
    15. Laurens Cherchye & Wim Moesen & Tom Van Puyenbroeck, 2004. "Legitimately Diverse, yet Comparable: On Synthesizing Social Inclusion Performance in the EU," Journal of Common Market Studies, Wiley Blackwell, vol. 42(5), pages 919-955, December.
    16. Yancang Li & Lei Zhao & Juanjuan Suo, 2014. "Comprehensive Assessment on Sustainable Development of Highway Transportation Capacity Based on Entropy Weight and TOPSIS," Sustainability, MDPI, vol. 6(7), pages 1-9, July.
    17. Cristina Davino & Rosaria Romano, 2014. "Assessment of Composite Indicators Using the ANOVA Model Combined with Multivariate Methods," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 119(2), pages 627-646, November.
    18. Junfei Chen & Juan Ji & Huimin Wang & Menghua Deng & Cong Yu, 2020. "Risk Assessment of Urban Rainstorm Disaster Based on Multi-Layer Weighted Principal Component Analysis: A Case Study of Nanjing, China," IJERPH, MDPI, vol. 17(15), pages 1-19, July.
    19. Iván Boal-San Miguel & Luis César Herrero-Prieto, 2020. "Reliability of Creative Composite Indicators with Territorial Specification in the EU," Sustainability, MDPI, vol. 12(8), pages 1-27, April.
    20. Stéphane Blancard & Maximin Bonnet & Jean-François Hoarau, 2021. "The influence of agriculture on the structural economic vulnerability of small island spaces: Assessment using DEA based composite indicators," Applied Economics, Taylor & Francis Journals, vol. 53(1), pages 79-97, January.
    21. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    22. Gerdessen, Johanna C. & Pascucci, Stefano, 2013. "Data Envelopment Analysis of sustainability indicators of European agricultural systems at regional level," Agricultural Systems, Elsevier, vol. 118(C), pages 78-90.
    23. Ustaoglu, E. & Aydınoglu, A.C., 2020. "Suitability evaluation of urban construction land in Pendik district of Istanbul, Turkey," Land Use Policy, Elsevier, vol. 99(C).
    24. Raf Guns & Ronald Rousseau, 2014. "Recommending research collaborations using link prediction and random forest classifiers," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1461-1473, November.
    25. Michael Freudenberg, 2003. "Composite Indicators of Country Performance: A Critical Assessment," OECD Science, Technology and Industry Working Papers 2003/16, OECD Publishing.
    26. Mateusz Tomal, 2021. "Analysing the coupling coordination degree of socio-economic-infrastructural development and its obstacles: the case study of Polish rural municipalities," Applied Economics Letters, Taylor & Francis Journals, vol. 28(13), pages 1098-1103, July.
    27. Frederik Booysen, 2002. "An Overview and Evaluation of Composite Indices of Development," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 59(2), pages 115-151, August.
    28. Janusz Myszczyszyn & Irena Lacka & Sylwia Golab & Beata Bedzik & Blazej Supron, 2021. "A Preliminary Analysis of the Relationship between Economic Growth and Selected Innovativeness Indicators on the Example of Four European Union Countries," European Research Studies Journal, European Research Studies Journal, vol. 0(Special 2), pages 402-418.
    29. Judith G. Kelley & Beth A. Simmons, 2015. "Politics by Number: Indicators as Social Pressure in International Relations," American Journal of Political Science, John Wiley & Sons, vol. 59(1), pages 55-70, January.
    30. TANNIER, Cécile & THOMAS, Isabelle, 2013. "Defining and characterizing urban boundaries: a fractal analysis of theoretical cities and Belgian cities," LIDAM Reprints CORE 2521, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    31. Zhao, Yabo & Wang, Shaojian & Ge, Yuejing & Liu, Qianqian & Liu, Xiaofeng, 2017. "The spatial differentiation of the coupling relationship between urbanization and the eco-environment in countries globally: A comprehensive assessment," Ecological Modelling, Elsevier, vol. 360(C), pages 313-327.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laurens CHERCHYE & Willem MOESEN & Nicky ROGGE & Tom VAN PUYENBROECK, 2009. "Constructing a knowledge economy composite indicator with imprecise data," Working Papers of Department of Economics, Leuven ces09.15, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    2. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    3. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    4. Cherchye, Laurens & Knox Lovell, C.A. & Moesen, Wim & Van Puyenbroeck, Tom, 2007. "One market, one number? A composite indicator assessment of EU internal market dynamics," European Economic Review, Elsevier, vol. 51(3), pages 749-779, April.
    5. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    6. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    7. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    8. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    9. Gaganis, Chrysovalantis & Pasiouras, Fotios & Tasiou, Menelaos & Zopounidis, Constantin, 2021. "CISEF: A composite index of social, environmental and financial performance," European Journal of Operational Research, Elsevier, vol. 291(1), pages 394-409.
    10. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    11. Chao Shi & Kenneth C. Land, 2021. "The Data Envelopment Analysis and Equal Weights/Minimax Methods of Composite Social Indicator Construction: a Methodological Study of Data Sensitivity and Robustness," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 16(4), pages 1689-1716, August.
    12. Grupp, Hariolf & Schubert, Torben, 2010. "Review and new evidence on composite innovation indicators for evaluating national performance," Research Policy, Elsevier, vol. 39(1), pages 67-78, February.
    13. Riccardo Natoli & Segu Zuhair, 2011. "Measuring Progress: A Comparison of the GDP, HDI, GS and the RIE," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 103(1), pages 33-56, August.
    14. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    15. Jia, Xibei & Buyle, Sven & Macário, Rosário, 2023. "Developing an airport sustainability evaluation index through composite indicator approach," Journal of Air Transport Management, Elsevier, vol. 113(C).
    16. Serrao, Amilcar, 2008. "Measuring Eco-efficiency of Agricultural Activity in European Countries: A Malmquist Index Analysis," 2008 Annual Meeting, July 27-29, 2008, Orlando, Florida 6152, American Agricultural Economics Association (New Name 2008: Agricultural and Applied Economics Association).
    17. Karagiannis, Giannis & Ravanos, Panagiotis, 2023. "A composite indicator of social inclusion for EU based on the inverted BoD model," Socio-Economic Planning Sciences, Elsevier, vol. 88(C).
    18. Giuliano Resce & Fritz Schiltz, 2021. "Sustainable Development in Europe: A Multicriteria Decision Analysis," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(2), pages 509-529, June.
    19. Fernanda Cortegoso Oliveira Frascareli & Marcelo Furlan & Enzo Barberio Mariano & Daniel Jugend, 2024. "A macro-level circular economy index: theoretical proposal and application in European Union countries," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(7), pages 18297-18331, July.
    20. Laurens Cherchye & Erwin Ooghe & Tom Puyenbroeck, 2008. "Robust human development rankings," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 6(4), pages 287-321, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:endesu:v:27:y:2025:i:3:d:10.1007_s10668-023-04116-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.