IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v144y2019i2d10.1007_s11205-018-02056-x.html
   My bibliography  Save this article

A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators

Author

Listed:
  • Milica Maricic

    (University of Belgrade)

  • Jose A. Egea

    (Technical University of Cartagena)

  • Veljko Jeremic

    (University of Belgrade)

Abstract

Considering the impact composite indicators can have on public opinion and policy development, the need for their frameworks to be methodologically sound and statistically verified is growing daily. One of the issues in the process of composite indicator construction which has generated much debate is how to choose the weighting scheme. To address this slippery step, we propose an optimization approach based on the enhanced Scatter Search (eSS) metaheuristic. In this paper, the eSS algorithm is applied to obtain a weighting scheme which will increase the stability of the composite indicator. The objective function is based on the relative contributions of indicators, while the problem constraints rely on the bootstrap Composite I-distance Indicator (CIDI) approach which is also proposed herein. The eSS-CIDI approach combines the exploration capability of eSS and the data-driven constraints devised from the bootstrap CIDI. This novel weighting approach was tested on two acknowledged composite indicators: the Academic Ranking of World Universities (ARWU) and the Networked Readiness Index (NRI). Results indicate that the composite indicators created using the eSS-CIDI weighting approach are more stable than the official ones.

Suggested Citation

  • Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    • Handle: RePEc:spr:soinre:v:144:y:2019:i:2:d:10.1007_s11205-018-02056-x
    DOI: 10.1007/s11205-018-02056-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-018-02056-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-018-02056-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Catherine Dehon & Alice McCathie & Vincenzo Verardi, 2010. "Uncovering excellence in academic rankings: a closer look at the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 83(2), pages 515-524, May.
    3. Reggi, Luigi & Arduini, Davide & Biagetti, Marco & Zanfei, Antonello, 2014. "How advanced are Italian regions in terms of public e-services? The construction of a composite indicator to analyze patterns of innovation diffusion in the public sector," Telecommunications Policy, Elsevier, vol. 38(5), pages 514-529.
    4. Grupp, Hariolf & Schubert, Torben, 2010. "Review and new evidence on composite innovation indicators for evaluating national performance," Research Policy, Elsevier, vol. 39(1), pages 67-78, February.
    5. Dubey, Hari Mohan & Pandit, Manjaree & Panigrahi, B.K., 2016. "Hydro-thermal-wind scheduling employing novel ant lion optimization technique with composite ranking index," Renewable Energy, Elsevier, vol. 99(C), pages 18-34.
    6. Rogge, Nicky, 2018. "Composite indicators as generalized benefit-of-the-doubt weighted averages," European Journal of Operational Research, Elsevier, vol. 267(1), pages 381-392.
    7. Zhou, P. & Ang, B.W. & Poh, K.L., 2006. "Comparing aggregating methods for constructing the composite environmental index: An objective measure," Ecological Economics, Elsevier, vol. 59(3), pages 305-311, September.
    8. Riccardo De Bin & Silke Janitza & Willi Sauerbrei & Anne-Laure Boulesteix, 2016. "Subsampling versus bootstrapping in resampling-based model selection for multivariable regression," Biometrics, The International Biometric Society, vol. 72(1), pages 272-280, March.
    9. Ebert, Udo & Welsch, Heinz, 2004. "Meaningful environmental indices: a social choice approach," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 270-283, March.
    10. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    11. Wang, Jiang-Jiang & Jing, You-Yin & Zhang, Chun-Fa & Zhao, Jun-Hong, 2009. "Review on multi-criteria decision analysis aid in sustainable energy decision-making," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(9), pages 2263-2278, December.
    12. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    13. Michela Nardo & Michaela Saisana & Andrea Saltelli & Stefano Tarantola & Anders Hoffman & Enrico Giovannini, 2005. "Handbook on Constructing Composite Indicators: Methodology and User Guide," OECD Statistics Working Papers 2005/3, OECD Publishing.
    14. Giuseppe Munda, 2005. "“Measuring Sustainability”: A Multi-Criterion Framework," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 7(1), pages 117-134, January.
    15. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    16. Pollesch, N.L. & Dale, V.H., 2016. "Normalization in sustainability assessment: Methods and implications," Ecological Economics, Elsevier, vol. 130(C), pages 195-208.
    17. M. Marković & S. Zdravković & M. Mitrović & A. Radojičić, 2016. "An Iterative Multivariate Post Hoc I-Distance Approach in Evaluating OECD Better Life Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 126(1), pages 1-19, March.
    18. Henk F. Moed, 2017. "A critical comparative analysis of five world university rankings," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 967-990, February.
    19. Hussein Sayed & Ramadan Hamed & Mohamed Ramadan & Samaa Hosny, 2015. "Using Meta-goal Programming for a New Human Development Indicator with Distinguishable Country Ranks," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 123(1), pages 1-27, August.
    20. Stelios H Zanakis & William Newburry & Vasyl Taras, 2016. "Global Social Tolerance Index and multi-method country rankings sensitivity," Journal of International Business Studies, Palgrave Macmillan;Academy of International Business, vol. 47(4), pages 480-497, May.
    21. Rogge, Nicky, 2012. "Undesirable specialization in the construction of composite policy indicators: The Environmental Performance Index," Working Papers 2012/08, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    22. Enrico Casadio Tarabusi & Giulio Guarini, 2013. "An Unbalance Adjustment Method for Development Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 112(1), pages 19-45, May.
    23. Iñaki Permanyer, 2011. "Assessing The Robustness Of Composite Indices Rankings," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 57(2), pages 306-326, June.
    24. Grupp, Hariolf & Mogee, Mary Ellen, 2004. "Indicators for national science and technology policy: how robust are composite indicators?," Research Policy, Elsevier, vol. 33(9), pages 1373-1384, November.
    25. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    26. Lahdelma, Risto & Hokkanen, Joonas & Salminen, Pekka, 1998. "SMAA - Stochastic multiobjective acceptability analysis," European Journal of Operational Research, Elsevier, vol. 106(1), pages 137-143, April.
    27. Xu, Li-Wen & Yang, Fang-Qin & Abula, Aji’erguli & Qin, Shuang, 2013. "A parametric bootstrap approach for two-way ANOVA in presence of possible interactions with unequal variances," Journal of Multivariate Analysis, Elsevier, vol. 115(C), pages 172-180.
    28. Dobrota, Marina & Martic, Milan & Bulajic, Milica & Jeremic, Veljko, 2015. "Two-phased composite I-distance indicator approach for evaluation of countries’ information development," Telecommunications Policy, Elsevier, vol. 39(5), pages 406-420.
    29. Cinzia Daraio & Andrea Bonaccorsi, 2017. "Beyond university rankings? Generating new indicators on universities by linking data in open platforms," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(2), pages 508-529, February.
    30. Zoltán J. Ács & Erkko Autio & László Szerb, 2015. "National Systems of Entrepreneurship: Measurement issues and policy implications," Chapters, in: Global Entrepreneurship, Institutions and Incentives, chapter 28, pages 523-541, Edward Elgar Publishing.
    31. Koen Decancq & María Ana Lugo, 2013. "Weights in Multidimensional Indices of Wellbeing: An Overview," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 7-34, January.
    32. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    33. James E. Foster & Mark McGillivray & Suman Seth, 2013. "Composite Indices: Rank Robustness, Statistical Association, and Redundancy," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 35-56, January.
    34. Domingo Docampo & Lawrence Cram, 2015. "On the effects of institutional size in university classifications: the case of the Shanghai ranking," Scientometrics, Springer;Akadémiai Kiadó, vol. 102(2), pages 1325-1346, February.
    35. Laurens Cherchye & Erwin Ooghe & Tom Puyenbroeck, 2008. "Robust human development rankings," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 6(4), pages 287-321, December.
    36. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    37. Gary Ferrier & Joseph Hirschberg, 1999. "Can We Bootstrap DEA Scores?," Journal of Productivity Analysis, Springer, vol. 11(1), pages 81-92, February.
    38. Milan Dobrota & Marina Dobrota, 2016. "ARWU ranking uncertainty and sensitivity: What if the award factor was Excluded?," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(2), pages 480-482, February.
    39. Veljko Jeremic & Milica Bulajic & Milan Martic & Zoran Radojicic, 2011. "A fresh approach to evaluating the academic ranking of world universities," Scientometrics, Springer;Akadémiai Kiadó, vol. 87(3), pages 587-596, June.
    40. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    41. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    42. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    43. Konietschke, Frank & Bathke, Arne C. & Harrar, Solomon W. & Pauly, Markus, 2015. "Parametric and nonparametric bootstrap methods for general MANOVA," Journal of Multivariate Analysis, Elsevier, vol. 140(C), pages 291-301.
    44. Milica Maricic & Milica Kostic-Stankovic, 2016. "Towards an impartial Responsible Competitiveness Index: a twofold multivariate I-distance approach," Quality & Quantity: International Journal of Methodology, Springer, vol. 50(1), pages 103-120, January.
    45. Marina Dobrota & Milica Bulajic & Lutz Bornmann & Veljko Jeremic, 2016. "A new approach to the QS university ranking using the composite I-distance indicator: Uncertainty and sensitivity analyses," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 67(1), pages 200-211, January.
    46. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    47. Edirisinghe, N.C.P. & Zhang, X., 2010. "Input/output selection in DEA under expert information, with application to financial markets," European Journal of Operational Research, Elsevier, vol. 207(3), pages 1669-1678, December.
    48. Michael Freudenberg, 2003. "Composite Indicators of Country Performance: A Critical Assessment," OECD Science, Technology and Industry Working Papers 2003/16, OECD Publishing.
    49. Ariel Kleiner & Ameet Talwalkar & Purnamrita Sarkar & Michael I. Jordan, 2014. "A scalable bootstrap for massive data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(4), pages 795-816, September.
    50. Gupta, Jatinder N. D. & Sexton, Randall S., 1999. "Comparing backpropagation with a genetic algorithm for neural network training," Omega, Elsevier, vol. 27(6), pages 679-684, December.
    51. Eric L. Sevigny & Michaela Saisana, 2016. "Measuring Interstate Variations in the Consequences of Illegal Drugs: A Composite Indicator Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(2), pages 501-529, September.
    52. Francesca Giambona & Erasmo Vassallo, 2013. "Composite Indicator of Financial Development in a Benefit-of-Doubt Approach," Economic Notes, Banca Monte dei Paschi di Siena SpA, vol. 42(2), pages 171-202, July.
    53. Hussein Sayed & Ramadan Hamed & Samaa Hazem Hosny & Alyaa Hegazy Abdelhamid, 2018. "Avoiding Ranking Contradictions in Human Development Index Using Goal Programming," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 138(2), pages 405-442, July.
    54. Wang, Xiaoting & Triantaphyllou, Evangelos, 2008. "Ranking irregularities when evaluating alternatives by using some ELECTRE methods," Omega, Elsevier, vol. 36(1), pages 45-63, February.
    55. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    56. Issaka Dialga & Le Thi Hang Giang, 2017. "Highlighting Methodological Limitations in the Steps of Composite Indicators Construction," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 131(2), pages 441-465, March.
    57. Verbunt, Pim & Rogge, Nicky, 2018. "Geometric composite indicators with compromise Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 264(1), pages 388-401.
    58. Saisana, Michaela & d'Hombres, Béatrice & Saltelli, Andrea, 2011. "Rickety numbers: Volatility of university rankings and policy implications," Research Policy, Elsevier, vol. 40(1), pages 165-177, February.
    59. Frederik Booysen, 2002. "An Overview and Evaluation of Composite Indices of Development," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 59(2), pages 115-151, August.
    60. Pilar Murias & José Miguel & David Rodríguez, 2008. "A Composite Indicator for University Quality Assesment: The Case of Spanish Higher Education System," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 89(1), pages 129-146, October.
    61. D K Despotis, 2005. "A reassessment of the human development index via data envelopment analysis," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(8), pages 969-980, August.
    62. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    63. Salvatore Greco & Alessio Ishizaka & Benedetto Matarazzo & Gianpiero Torrisi, 2018. "Stochastic multi-attribute acceptability analysis (SMAA): an application to the ranking of Italian regions," Regional Studies, Taylor & Francis Journals, vol. 52(4), pages 585-600, April.
    64. T Joro & E-J Viitala, 2004. "Weight-restricted DEA in action: from expert opinions to mathematical models," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 55(8), pages 814-821, August.
    65. Fusco, Elisa, 2015. "Enhancing non-compensatory composite indicators: A directional proposal," European Journal of Operational Research, Elsevier, vol. 242(2), pages 620-630.
    66. D. R. Cox & R. Fitzpatrick & A. E. Fletcher & S. M. Gore & D. J. Spiegelhalter & D. R. Jones, 1992. "Quality‐Of‐Life Assessment: Can We Keep it Simple?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 155(3), pages 353-375, May.
    67. Mariano, Enzo Barberio & Sobreiro, Vinicius Amorim & Rebelatto, Daisy Aparecida do Nascimento, 2015. "Human development and data envelopment analysis: A structured literature review," Omega, Elsevier, vol. 54(C), pages 33-49.
    68. Milica Jovanovic & Veljko Jeremic & Gordana Savic & Milica Bulajic & Milan Martic, 2012. "How does the normalization of data affect the ARWU ranking?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(2), pages 319-327, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    2. Giménez, Víctor & Prior, Diego & Thieme, Claudio & Tortosa-Ausina, Emili, 2024. "International comparisons of COVID-19 pandemic management: What can be learned from activity analysis techniques?," Omega, Elsevier, vol. 122(C).
    3. Matheus Pereira Libório & João Francisco Abreu & Petr Iakovlevitch Ekel & Alexei Manso Correa Machado, 2023. "Effect of sub-indicator weighting schemes on the spatial dependence of multidimensional phenomena," Journal of Geographical Systems, Springer, vol. 25(2), pages 185-211, April.
    4. Atieno, Prisca, 2021. "The effects of outdated data and outliers on Kenya's 2019 Global Food Security Index score and rank," Research Theses 334773, Collaborative Masters Program in Agricultural and Applied Economics.
    5. Kateryna Tkach & Chiara Gigliarano, 2022. "Multidimensional Poverty Index with Dependence-Based Weights," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 161(2), pages 843-872, June.
    6. Alexei Manso Correa Machado & Petr Iakovlevitch Ekel & Matheus Pereira Libório, 2023. "Goal-based participatory weighting scheme: balancing objectivity and subjectivity in the construction of composite indicators," Quality & Quantity: International Journal of Methodology, Springer, vol. 57(5), pages 4387-4407, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    2. Rogge, Nicky, 2018. "Composite indicators as generalized benefit-of-the-doubt weighted averages," European Journal of Operational Research, Elsevier, vol. 267(1), pages 381-392.
    3. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    4. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    5. Maričić Milica & Bulajić Milica & Radojičić Zoran & Jeremić Veljko, 2019. "Shedding Light on the Doing Business Index: a Machine Learning Approach," Business Systems Research, Sciendo, vol. 10(2), pages 73-84, September.
    6. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    7. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    8. Giuliano Resce & Fritz Schiltz, 2021. "Sustainable Development in Europe: A Multicriteria Decision Analysis," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(2), pages 509-529, June.
    9. P. Zhou & B. Ang, 2009. "Comparing MCDA Aggregation Methods in Constructing Composite Indicators Using the Shannon-Spearman Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(1), pages 83-96, October.
    10. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    11. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    12. Tianjiao Wang & Yelin Fu, 2020. "Constructing Composite Indicators with Individual Judgements and Best–Worst Method: An Illustration of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(1), pages 1-14, May.
    13. Giuseppe Coco & Raffaele Lagravinese & Giuliano Resce, 2020. "Beyond the weights: a multicriteria approach to evaluate inequality in education," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 18(4), pages 469-489, December.
    14. Su, Weihua & Chen, Sibo & Zhang, Chonghui & Li, Kevin W., 2023. "A subgroup dominance-based benefit of the doubt method for addressing rank reversals: A case study of the human development index in Europe," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1299-1317.
    15. Riccardo Natoli & Segu Zuhair, 2011. "Measuring Progress: A Comparison of the GDP, HDI, GS and the RIE," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 103(1), pages 33-56, August.
    16. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    17. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    18. Annalina Sarra & Eugenia Nissi, 2020. "A Spatial Composite Indicator for Human and Ecosystem Well-Being in the Italian Urban Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 148(2), pages 353-377, April.
    19. Laurens CHERCHYE & Willem MOESEN & Nicky ROGGE & Tom VAN PUYENBROECK, 2009. "Constructing a knowledge economy composite indicator with imprecise data," Working Papers of Department of Economics, Leuven ces09.15, KU Leuven, Faculty of Economics and Business (FEB), Department of Economics, Leuven.
    20. Maričić Milica & Bulajić Milica & Radojičić Zoran & Jeremić Veljko, 2016. "Multivariate approach to imposing additional constraints on the Benefit-of-the-Doubt model: The case of QS World University Rankings by Subject," Croatian Review of Economic, Business and Social Statistics, Sciendo, vol. 2(1), pages 1-14, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:144:y:2019:i:2:d:10.1007_s11205-018-02056-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.