IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v157y2021i2d10.1007_s11205-021-02673-z.html
   My bibliography  Save this article

Composite Index Ranking of Economic Well-Being in U.S. Metropolitan Areas: How Prevalent are Rank Anomalies?

Author

Listed:
  • Justin Ehrlich

    (Syracuse University)

  • Simon Medcalfe

    (Augusta University)

  • Shane Sanders

    (Syracuse University)

Abstract

Composite indicators have the advantage of summarizing complex multi-dimensional concepts in a single measurement. They also suffer from disadvantages such as subjectivity in choice of indicators, weighting, and aggregation methods. In this paper, we update Medcalfe’s (Social Indicators Research 139(3), 1147–1167. https://doi.org/10.1007/s11205-017-1755-5 . 2018) Economic Well-Being (EWB) index of US Metropolitan Statistical Areas with the latest (2017) available data. Using this index of EWB, we investigate two social choice violations that have been understudied in the composite indicators literature. We provide theoretical and empirical evidence of cycles and violations of independence of irrelevant alternatives. Depending on the number of cities and ranking components, incidence of these social choice violations can be large, creating ambiguity in a set of rankings. In general, having more ranking components reduces the expected and, for the most part, realized, incidence of social choice violations. Further, the results suggest that the EWB index rankings should potentially be interpreted in terms of rank tiers rather than in terms of individual rankings.

Suggested Citation

  • Justin Ehrlich & Simon Medcalfe & Shane Sanders, 2021. "Composite Index Ranking of Economic Well-Being in U.S. Metropolitan Areas: How Prevalent are Rank Anomalies?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 543-562, September.
    • Handle: RePEc:spr:soinre:v:157:y:2021:i:2:d:10.1007_s11205-021-02673-z
    DOI: 10.1007/s11205-021-02673-z
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-021-02673-z
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-021-02673-z?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Donald Epley & Mohan Menon, 2008. "A Method of Assembling Cross-sectional Indicators into a Community Quality of Life," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 88(2), pages 281-296, September.
    2. Leonardo S. Alaimo & Filomena Maggino, 2020. "Sustainable Development Goals Indicators at Territorial Level: Conceptual and Methodological Issues—The Italian Perspective," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 147(2), pages 383-419, January.
    3. Griffith, Amanda & Rask, Kevin, 2007. "The influence of the US News and World Report collegiate rankings on the matriculation decision of high-ability students: 1995-2004," Economics of Education Review, Elsevier, vol. 26(2), pages 244-255, April.
    4. Giuseppe Munda, 2012. "Choosing Aggregation Rules for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 109(3), pages 337-354, December.
    5. Simon Medcalfe, 2018. "Economic Well-Being in U.S. Metropolitan Statistical Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(3), pages 1147-1167, October.
    6. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    7. Paulo Morais & Vera Miguéis & Ana Camanho, 2013. "Quality of Life Experienced by Human Capital: An Assessment of European Cities," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 110(1), pages 187-206, January.
    8. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    9. Jan Lorenz & Christoph Brauer & Dirk Lorenz, 2017. "Rank-Optimal Weighting or “How to be Best in the OECD Better Life Index?”," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 134(1), pages 75-92, October.
    10. Martin Schlossarek & Miroslav Syrovátka & Ondřej Vencálek, 2019. "The Importance of Variables in Composite Indices: A Contribution to the Methodology and Application to Development Indices," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 145(3), pages 1125-1160, October.
    11. Matteo Mazziotta, Adriano Pareto, 2013. "Methods For Constructing Composite Indices: One For All Or All For One?," RIEDS - Rivista Italiana di Economia, Demografia e Statistica - The Italian Journal of Economic, Demographic and Statistical Studies, SIEDS Societa' Italiana di Economia Demografia e Statistica, vol. 67(2), pages 67-80, April-Jun.
    12. Juan Martín & Cira Mendoza, 2013. "A DEA Approach to Measure the Quality-of-Life in the Municipalities of the Canary Islands," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 113(1), pages 335-353, August.
    13. Vicente Royuela & Jordi Suriñach & Mónica Reyes, 2003. "Measuring Quality of Life in Small Areas Over Different Periods of Time," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 64(1), pages 51-74, October.
    14. Benjamin Saitluanga, 2014. "Spatial Pattern of Urban Livability in Himalayan Region: A Case of Aizawl City, India," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 117(2), pages 541-559, June.
    15. Tianjiao Wang & Yelin Fu, 2020. "Constructing Composite Indicators with Individual Judgements and Best–Worst Method: An Illustration of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(1), pages 1-14, May.
    16. Guido Bonatti & Enrico Ivaldi & Riccardo Soliani, 2017. "Quality of life in Italian cities: a temporal comparison between before the crisis and after," International Journal of Social Economics, Emerald Group Publishing Limited, vol. 44(4), pages 560-574, April.
    17. Boudreau, James & Ehrlich, Justin & Sanders, Shane & Winn, Adam, 2014. "Social choice violations in rank sum scoring: A formalization of conditions and corrective probability computations," Mathematical Social Sciences, Elsevier, vol. 71(C), pages 20-29.
    18. Frederik Booysen, 2002. "An Overview and Evaluation of Composite Indices of Development," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 59(2), pages 115-151, August.
    19. James Boudreau & Justin Ehrlich & Mian Farrukh Raza & Shane Sanders, 2018. "The likelihood of social choice violations in rank sum scoring: algorithms and evidence from NCAA cross country running," Public Choice, Springer, vol. 174(3), pages 219-238, March.
    20. Thomas Hammond, 2007. "Rank injustice?: How the scoring method for cross-country running competitions violates major social choice principles," Public Choice, Springer, vol. 133(3), pages 359-375, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Driss El Kadiri Boutchich, 2023. "Model for Promoting Corporate Social Performance Measurement and Social Change: Elaboration from Causal Analysis Between the Both," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 169(1), pages 209-234, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Beatriz Valcárcel-Aguiar & Pilar Murias, 2019. "Evaluation and Management of Urban Liveability: A Goal Programming Based Composite Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 142(2), pages 689-712, April.
    2. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "The Ordinal Input for Cardinal Output Approach of Non-compensatory Composite Indicators: The PROMETHEE Scoring Method," MPRA Paper 95816, University Library of Munich, Germany.
    3. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2021. "The ordinal input for cardinal output approach of non-compensatory composite indicators: the PROMETHEE scoring method," European Journal of Operational Research, Elsevier, vol. 288(1), pages 225-246.
    4. Rajko Tomaš, 2022. "Measurement of the Concentration of Potential Quality of Life in Local Communities," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 163(1), pages 79-109, August.
    5. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    6. Kurt S. Riedel, 2019. "Combinatorial Models of Cross-Country Dual Meets: What is a Big Victory?," Papers 1911.05044, arXiv.org.
    7. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    8. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    9. Beatriz Valcárcel-Aguiar & Pilar Murias & Alexandre Vecino-Aguirre, 2022. "Liveability Versus Sustainability in Spanish Cities: First Evidences Using Synthetic Indicators," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 17(4), pages 1935-1960, August.
    10. Valér Veres & József Benedek & Ibolya Török, 2022. "Changes in the Regional Development of Romania (2000–2019), Measured with a Multidimensional PEESH Index," Sustainability, MDPI, vol. 14(21), pages 1-29, November.
    11. Sayel Basel & K. U. Gopakumar & R. Prabhakara Rao, 2020. "Broad-based index for measurement of development," Journal of Social and Economic Development, Springer;Institute for Social and Economic Change, vol. 22(1), pages 182-206, June.
    12. Cinelli, Marco & Kadziński, Miłosz & Gonzalez, Michael & Słowiński, Roman, 2020. "How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy," Omega, Elsevier, vol. 96(C).
    13. Marco Dugato & Francesco Calderoni & Gian Maria Campedelli, 2020. "Measuring Organised Crime Presence at the Municipal Level," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 147(1), pages 237-261, January.
    14. Casas i Klett, Tomas & Cozzi, Guido & Diebold, Celine & Zeller, Camille, 2020. "Measuring Elite Quality," MPRA Paper 102068, University Library of Munich, Germany.
    15. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    16. Gaganis, Chrysovalantis & Pasiouras, Fotios & Tasiou, Menelaos & Zopounidis, Constantin, 2021. "CISEF: A composite index of social, environmental and financial performance," European Journal of Operational Research, Elsevier, vol. 291(1), pages 394-409.
    17. Eduardo González & Ana Cárcaba & Juan Ventura, 2018. "Weight Constrained DEA Measurement of the Quality of Life in Spanish Municipalities in 2011," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(3), pages 1157-1182, April.
    18. Drago, Carlo & Gatto, Andrea, 2023. "Gauging energy poverty in developing countries with a composite metric of electricity access," Utilities Policy, Elsevier, vol. 81(C).
    19. Matteo Mazziotta & Adriano Pareto, 2022. "Composite Indices Construction: The Performance Interval Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 161(2), pages 541-551, June.
    20. Mariano, Enzo Barberio & Sobreiro, Vinicius Amorim & Rebelatto, Daisy Aparecida do Nascimento, 2015. "Human development and data envelopment analysis: A structured literature review," Omega, Elsevier, vol. 54(C), pages 33-49.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:157:y:2021:i:2:d:10.1007_s11205-021-02673-z. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.