IDEAS home Printed from https://ideas.repec.org/p/sls/resrep/1210.html
   My bibliography  Save this paper

An Assessment of Weighting Methodologies for Composite Indicators: The case of the Index of Economic Well-being

Author

Listed:
  • Andrew Sharpe
  • Brendon Andrews

Abstract

The Index of Economic Well-Being (IEWB) – a composite indicator consisting of consumption, wealth, equality, and economic security – underwent several changes in the weighting of its components. For example, the final aggregation of the IEWB was changed to equal weighting after the IEWB was criticized for having a bias against sustainability; however, all weighting schemes have both advantages and shortcomings. To isolate the preferred ordinal ranking for the results, strong and weak dominance rules were established for countries across several observed weighting schemes, and each of these rules were ranked in all possible ways. An 'iterative dominance equilibrium' was computed for comparison to observed weighting schemes. Constrained data envelopment analysis (CDEA) performed best, yet CDEA is not ideal for comparisons across countries. Among explicit weights, the original weights of the IEWB were best. Although the original weights are supported, they were controversial – a shift to equal weights mitigated this controversial – it appears equal weights remain least objectionable.

Suggested Citation

  • Andrew Sharpe & Brendon Andrews, 2012. "An Assessment of Weighting Methodologies for Composite Indicators: The case of the Index of Economic Well-being," CSLS Research Reports 2012-10, Centre for the Study of Living Standards.
    • Handle: RePEc:sls:resrep:1210
    as

    Download full text from publisher

    File URL: http://www.csls.ca/reports/csls2012-10.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Giuseppe Nicoletti & Stefano Scarpetta & Olivier Boylaud, 2000. "Summary Indicators of Product Market Regulation with an Extension to Employment Protection Legislation," OECD Economics Department Working Papers 226, OECD Publishing.
    2. Andrew Sharpe & Lars Osberg, 2009. "New Estimates of the Index of Economic Well-being for Canada and the Provinces, 1981 - 2008," CSLS Research Reports 2009-10, Centre for the Study of Living Standards.
    3. Charles I. Jones & Peter J. Klenow, 2016. "Beyond GDP? Welfare across Countries and Time," American Economic Review, American Economic Association, vol. 106(9), pages 2426-2457, September.
    4. Andrew Sharpe & Lars Osberg, 2009. "New Estimates of the Index of Economic Well-being for Selected OECD Countries, 1981 - 2007," CSLS Research Reports 2009-11, Centre for the Study of Living Standards.
    5. Laurens Cherchye & Erwin Ooghe & Tom Puyenbroeck, 2008. "Robust human development rankings," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 6(4), pages 287-321, December.
    6. Lars Osberg & Andrew Sharpe, 2005. "How Should We Measure The “Economic” Aspects Of Well‐Being?," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 51(2), pages 311-336, June.
    7. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    8. Koen Decancq & María Ana Lugo, 2013. "Weights in Multidimensional Indices of Wellbeing: An Overview," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 7-34, January.
    9. Laurens Cherchye & Wim Moesen & Tom Van Puyenbroeck, 2004. "Legitimately Diverse, yet Comparable: On Synthesizing Social Inclusion Performance in the EU," Journal of Common Market Studies, Wiley Blackwell, vol. 42(5), pages 919-955, December.
    10. R. J. Rummel, 1967. "Understanding factor analysis," Journal of Conflict Resolution, Peace Science Society (International), vol. 11(4), pages 444-480, December.
    11. Koen Decancq & Maria Ana Lugo, 2008. "Setting Weights in Multidimensional Indices of Well-Being," OPHI Working Papers 18, Queen Elizabeth House, University of Oxford.
    12. Lars Osberg & Andrew Sharpe, 2011. "Moving from a GDP-Based to a Well-Being Based Metric of Economic Performance and Social Progress: Results from the Index of Economic Well-Being for OECD Countries, 1980-2009," CSLS Research Reports 2011-12, Centre for the Study of Living Standards.
    13. Lars Osberg & Andrew Sharpe, 2010. "The Index of Economic Well-Being," Challenge, Taylor & Francis Journals, vol. 53(4), pages 25-42.
    14. C Kao & H-T Hung, 2005. "Data envelopment analysis with common weights: the compromise solution approach," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 56(10), pages 1196-1203, October.
    15. Saisana, Michaela & d'Hombres, Béatrice & Saltelli, Andrea, 2011. "Rickety numbers: Volatility of university rankings and policy implications," Research Policy, Elsevier, vol. 40(1), pages 165-177, February.
    16. Doyle, John R., 1995. "Multiattribute Choice for the Lazy Decision Maker: Let the Alternatives Decide!," Organizational Behavior and Human Decision Processes, Elsevier, vol. 62(1), pages 87-100, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Akin, Tarik & Iqbal, Zamir & Mirakhor, Abbas, 2016. "The composite risk-sharing finance index: Implications for Islamic finance," Review of Financial Economics, Elsevier, vol. 31(C), pages 18-25.
    2. Aleksandra Maksimovska & Aleksandar Stojkov, 2019. "Composite Indicator of Social Responsiveness of Local Governments: An Empirical Mapping of the Networked Community Governance Paradigm," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 669-706, July.
    3. Javier Antolín & Cristina de Torre & Miguel Á. García-Fuentes & Ana Pérez & Isabel Tomé & María L. Mirantes & Elena Hoyos, 2020. "Development of an Evaluation Framework for Smartness and Sustainability in Cities," Sustainability, MDPI, vol. 12(12), pages 1-25, June.
    4. Silvia Terzi & Andrea Pierini, 2015. "Data Envelopment Analysis (DEA) assessment of composite indicators of infrastructure endowment," Rivista di statistica ufficiale, ISTAT - Italian National Institute of Statistics - (Rome, ITALY), vol. 17(1), pages 5-18.
    5. Eduardo González & Ana Cárcaba & Juan Ventura, 2018. "Weight Constrained DEA Measurement of the Quality of Life in Spanish Municipalities in 2011," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(3), pages 1157-1182, April.
    6. Claire GOAVEC & Jean-François HOARAU, 2015. "Vulnérabilité Économique Structurelle Et Dépendance Touristique : Quels Enseignements Pour Les Petites Économies Insulaires En Développement," Region et Developpement, Region et Developpement, LEAD, Universite du Sud - Toulon Var, vol. 42, pages 157-188.
    7. Perry Burnett & Travis Brooks & Patrick Bassett, 2017. "Estimating Quality of Life and Place with Location Theory: The McBucks Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 134(2), pages 455-472, November.
    8. Jankiewicz, Jacek & Huderek-Glapska, Sonia, 2016. "The air transport market in Central and Eastern Europe after a decade of liberalisation – Different paths of growth," Journal of Transport Geography, Elsevier, vol. 50(C), pages 45-56.
    9. Claire Goavec & Jean-François Hoarau, 2015. "Structural economic vulnerability and tourism dependence: new assessment for small island developing economies [Vulnérabilité économique structurelle et dépendance touristique : quels enseignements," Post-Print hal-01454720, HAL.
    10. Ana Cárcaba & Eduardo González & Juan Ventura & Rubén Arrondo, 2017. "How Does Good Governance Relate to Quality of Life?," Sustainability, MDPI, vol. 9(4), pages 1-16, April.
    11. Hussein Sayed & Ramadan Hamed & Mohamed Ramadan & Samaa Hosny, 2015. "Using Meta-goal Programming for a New Human Development Indicator with Distinguishable Country Ranks," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 123(1), pages 1-27, August.
    12. Alessia Arcidiacono & Gianpiero Torrisi, 2022. "Decentralisation and Resilience: A Multidimensional Approach," Sustainability, MDPI, vol. 14(16), pages 1-25, August.
    13. Dipanwita De & Chandan Surabhi Das, 2021. "Measuring Livelihood Sustainability by PCA in Indian Sundarban," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(12), pages 18424-18442, December.
    14. Aloyce R. Kaliba & Anne G. Gongwe & Kizito Mazvimavi & Ashagre Yigletu, 2021. "Impact of Adopting Improved Seeds on Access to Broader Food Groups Among Small-Scale Sorghum Producers in Tanzania," SAGE Open, , vol. 11(1), pages 21582440209, January.
    15. Piotr Białowolski, 2015. "Concepts of Confidence in Tendency Survey Research: An Assessment with Multi-group Confirmatory Factor Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 123(1), pages 281-302, August.
    16. Ferrara, Antonella Rita & Dijkstra, Lewis & McCann, Philip & Nisticó, Rosanna, 2022. "The response of regional well-being to place-based policy interventions," Regional Science and Urban Economics, Elsevier, vol. 97(C).
    17. Ana Cárcaba & Eduardo González & Juan Ventura, 2017. "Social Progress in Spanish Municipalities (2001–2011)," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 12(4), pages 997-1019, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    2. Lars Osberg & Andrew Sharpe, 2011. "Moving from a GDP-Based to a Well-Being Based Metric of Economic Performance and Social Progress: Results from the Index of Economic Well-Being for OECD Countries, 1980-2009," CSLS Research Reports 2011-12, Centre for the Study of Living Standards.
    3. Lars Osberg & Andrew Sharpe, 2011. "Beyond GDP: Measuring Economic Well-Being in Canada and the Provinces, 1981-2010," CSLS Research Reports 2011-11, Centre for the Study of Living Standards.
    4. Géraldine Thiry, 2015. "Beyond GDP: Conceptual Grounds of Quantification. The Case of the Index of Economic Well-Being (IEWB)," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 121(2), pages 313-343, April.
    5. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    6. Lars Osberg, 2009. "Measuring Economic Security in Insecure Times: New Perspectives, New Events, and the Index of Economic Well-being," CSLS Research Reports 2009-12, Centre for the Study of Living Standards.
    7. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    8. Lars Osberg & Andrew Sharpe, 2014. "Measuring Economic Insecurity in Rich and Poor Nations," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 60(S1), pages 53-76, May.
    9. Antonio Jurado & Jesus Perez-Mayo, 2012. "Construction and Evolution of a Multidimensional Well-Being Index for the Spanish Regions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 107(2), pages 259-279, June.
    10. Rolf Aaberge & Andrea Brandolini, 2014. "Multidimensional poverty and inequality," Temi di discussione (Economic working papers) 976, Bank of Italy, Economic Research and International Relations Area.
    11. Fusco, Elisa & Vidoli, Francesco & Sahoo, Biresh K., 2018. "Spatial heterogeneity in composite indicator: A methodological proposal," Omega, Elsevier, vol. 77(C), pages 1-14.
    12. Lars Osberg & Andrew Sharpe, 2010. "The Index of Economic Well-Being," Challenge, Taylor & Francis Journals, vol. 53(4), pages 25-42.
    13. Nicholas Rohde & Kam Ki Tang & Prasada Rao, 2011. "Income volatility and insecurity in the U.S., Germany and Britain," Discussion Papers Series 434, School of Economics, University of Queensland, Australia.
    14. Brendon Andrews, 2015. "Sensitivity of the Index of Economic Well-Being to Different Measures of Poverty: LICO vs LIM," CSLS Research Reports 2015-10, Centre for the Study of Living Standards.
    15. Berloffa, Gabriella & Modena, Francesca, 2012. "Economic well-being in Italy: The role of income insecurity and intergenerational inequality," Journal of Economic Behavior & Organization, Elsevier, vol. 81(3), pages 751-765.
    16. James E. Foster & Mark McGillivray & Suman Seth, 2013. "Composite Indices: Rank Robustness, Statistical Association, and Redundancy," Econometric Reviews, Taylor & Francis Journals, vol. 32(1), pages 35-56, January.
    17. Maričić Milica & Bulajić Milica & Radojičić Zoran & Jeremić Veljko, 2019. "Shedding Light on the Doing Business Index: a Machine Learning Approach," Business Systems Research, Sciendo, vol. 10(2), pages 73-84, September.
    18. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    19. Stergios Athanassoglou, 2015. "Multidimensional welfare rankings under weight imprecision: a social choice perspective," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 44(4), pages 719-744, April.
    20. Giovanna Boccuzzo & Licia Maron, 2017. "Proposal of a composite indicator of job quality based on a measure of weighted distances," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(5), pages 2357-2374, September.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sls:resrep:1210. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: CSLS (email available below). General contact details of provider: https://edirc.repec.org/data/cslssca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.