IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v128y2016i3d10.1007_s11205-015-1078-3.html
   My bibliography  Save this article

Revisiting Worst-Case DEA for Composite Indicators

Author

Listed:
  • Stergios Athanassoglou

    (Bocconi University)

Abstract

Composite indicators are becoming increasingly influential tools of environmental assessment and advocacy. Nonetheless, their use is controversial as they often rely on ad-hoc and theoretically problematic assumptions regarding normalization, aggregation, and weighting. Nonparametric data envelopment analysis (DEA) methods, originating in the production-economics literature, have been proposed as a means of addressing these concerns. These methods dispense with contentious normalization and weighting techniques by focusing on a measure of best-case relative performance. Recently, the standard DEA model for composite indicators was extended to account for worst-case analysis by Zhou et al. (Ecol Econ 62(2):291–297, 2007) [hereafter, ZAP]. In this note we argue that, while valid and interesting in its own right, the measure adopted by ZAP may not capture, in a mathematical as well as practical sense, the notion of worst-case relative performance. By contrast, we focus on the strict worst-case analogue of standard DEA for composite indicators and show how it leads to tractable optimization problems. Finally, we compare the two methodologies using data from ZAP’s Sustainable Energy Index case study, demonstrating that they occasionally lead to divergent results.

Suggested Citation

  • Stergios Athanassoglou, 2016. "Revisiting Worst-Case DEA for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(3), pages 1259-1272, September.
  • Handle: RePEc:spr:soinre:v:128:y:2016:i:3:d:10.1007_s11205-015-1078-3
    DOI: 10.1007/s11205-015-1078-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-015-1078-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11205-015-1078-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Bohringer, Christoph & Jochem, Patrick E.P., 2007. "Measuring the immeasurable -- A survey of sustainability indices," Ecological Economics, Elsevier, vol. 63(1), pages 1-8, June.
    2. Zaim, Osman, 2004. "Measuring environmental performance of state manufacturing through changes in pollution intensities: a DEA framework," Ecological Economics, Elsevier, vol. 48(1), pages 37-47, January.
    3. Ebert, Udo & Welsch, Heinz, 2004. "Meaningful environmental indices: a social choice approach," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 270-283, March.
    4. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    5. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    6. Fare, R. & Grosskopf, S. & Hernandez-Sancho, F., 2004. "Environmental performance: an index number approach," Resource and Energy Economics, Elsevier, vol. 26(4), pages 343-352, December.
    7. Jin, Jingliang & Zhou, Dequn & Zhou, Peng, 2014. "Measuring environmental performance with stochastic environmental DEA: The case of APEC economies," Economic Modelling, Elsevier, vol. 38(C), pages 80-86.
    8. Ravallion, Martin, 2012. "Troubling tradeoffs in the Human Development Index," Journal of Development Economics, Elsevier, vol. 99(2), pages 201-209.
    9. Rogge, Nicky, 2012. "Undesirable specialization in the construction of composite policy indicators: The Environmental Performance Index," Working Papers 2012/08, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    10. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    11. Anderson, Gordon & Crawford, Ian & Leicester, Andrew, 2011. "Welfare rankings from multivariate data, a nonparametric approach," Journal of Public Economics, Elsevier, vol. 95(3-4), pages 247-252, April.
    12. Mónica Domínguez-Serrano & Francisco Blancas, 2011. "A Gender Wellbeing Composite Indicator: The Best-Worst Global Evaluation Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 102(3), pages 477-496, July.
    13. Zhang, Hai-Ying & Ji, Qiang & Fan, Ying, 2013. "An evaluation framework for oil import security based on the supply chain with a case study focused on China," Energy Economics, Elsevier, vol. 38(C), pages 87-95.
    14. Martin Ravallion, 2012. "Mashup Indices of Development," The World Bank Research Observer, World Bank, vol. 27(1), pages 1-32, February.
    15. Zhu, Joe, 2004. "A buyer-seller game model for selection and negotiation of purchasing bids: Extensions and new models," European Journal of Operational Research, Elsevier, vol. 154(1), pages 150-156, April.
    16. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    17. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    18. Cherchye, Laurens & Knox Lovell, C.A. & Moesen, Wim & Van Puyenbroeck, Tom, 2007. "One market, one number? A composite indicator assessment of EU internal market dynamics," European Economic Review, Elsevier, vol. 51(3), pages 749-779, April.
    19. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    20. William W. Cooper & Lawrence M. Seiford & Kaoru Tone, 2007. "Data Envelopment Analysis," Springer Books, Springer, edition 0, number 978-0-387-45283-8, September.
    21. Takamura, Yoshiharu & Tone, Kaoru, 2003. "A comparative site evaluation study for relocating Japanese government agencies out of Tokyo," Socio-Economic Planning Sciences, Elsevier, vol. 37(2), pages 85-102, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Verbunt, Pim & Rogge, Nicky, 2018. "Geometric composite indicators with compromise Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 264(1), pages 388-401.
    2. Gulati, Rachita & Kattumuri, Ruth & Kumar, Sunil, 2020. "A non-parametric index of corporate governance in the banking industry: An application to Indian data," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    3. Gulati, Rachita, 2022. "Bank ownership and governance quality in India: Evolution and detection of convergence clubs," The North American Journal of Economics and Finance, Elsevier, vol. 62(C).
    4. Enzo Barberio Mariano & Diogo Ferraz & Simone Cristina Oliveira Gobbo, 2021. "The Human Development Index with Multiple Data Envelopment Analysis Approaches: A Comparative Evaluation Using Social Network Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 443-500, September.
    5. Pinar, Mehmet & Stengos, Thanasis & Topaloglou, Nikolas, 2020. "On the construction of a feasible range of multidimensional poverty under benchmark weight uncertainty," European Journal of Operational Research, Elsevier, vol. 281(2), pages 415-427.
    6. Wang, Zhe & Yao-Ping Peng, Michael & Anser, Muhammad Khalid & Chen, Zhong, 2023. "Research on the impact of green finance and renewable energy on energy efficiency: The case study E−7 economies," Renewable Energy, Elsevier, vol. 205(C), pages 166-173.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Athanassoglou, Stergios, 2015. "Revisiting Worst-case DEA for Composite Indicators," Climate Change and Sustainable Development 198712, Fondazione Eni Enrico Mattei (FEEM).
    2. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    3. Rogge, Nicky, 2018. "Composite indicators as generalized benefit-of-the-doubt weighted averages," European Journal of Operational Research, Elsevier, vol. 267(1), pages 381-392.
    4. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    5. Verbunt, Pim & Rogge, Nicky, 2018. "Geometric composite indicators with compromise Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 264(1), pages 388-401.
    6. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    7. Blancard, Stéphane & Hoarau, Jean-François, 2013. "A new sustainable human development indicator for small island developing states: A reappraisal from data envelopment analysis," Economic Modelling, Elsevier, vol. 30(C), pages 623-635.
    8. Ernest Reig-Martínez, 2013. "Social and Economic Wellbeing in Europe and the Mediterranean Basin: Building an Enlarged Human Development Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 111(2), pages 527-547, April.
    9. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    10. Kortelainen, Mika, 2008. "Dynamic environmental performance analysis: A Malmquist index approach," Ecological Economics, Elsevier, vol. 64(4), pages 701-715, February.
    11. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    12. Yongjun Shen & Elke Hermans & Tom Brijs & Geert Wets, 2013. "Data Envelopment Analysis for Composite Indicators: A Multiple Layer Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(2), pages 739-756, November.
    13. P. Zhou & B. Ang, 2009. "Comparing MCDA Aggregation Methods in Constructing Composite Indicators Using the Shannon-Spearman Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(1), pages 83-96, October.
    14. Ernest Reig, 2012. "Building an Enlarged Human Development Indicator: Europe and the Southern Mediterranean Basin," Working Papers 1203, Department of Applied Economics II, Universidad de Valencia.
    15. Ju, Keyi & Su, Bin & Zhou, Dequn & Zhou, P. & Zhang, Yuqiang, 2015. "Oil price crisis response: Capability assessment and key indicator identification," Energy, Elsevier, vol. 93(P2), pages 1353-1360.
    16. Fusco, Elisa & Maggi, Bernardo & Rizzuto, Livia, 2022. "Alternative indicators for the evaluation of renewables in Europe: An efficiency approach," Renewable Energy, Elsevier, vol. 190(C), pages 48-65.
    17. Fu-Chiang Yang & Rui-Hsin Kao & Yi-Tui Chen & Yueh-Fei Ho & Cheng-Chung Cho & Shi-Wei Huang, 2018. "A Common Weight Approach to Construct Composite Indicators: The Evaluation of Fourteen Emerging Markets," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 137(2), pages 463-479, June.
    18. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    19. Susanna Sironen & Jyri Seppälä & Pekka Leskinen, 2015. "Towards more non-compensatory sustainable society index," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 17(3), pages 587-621, June.
    20. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:128:y:2016:i:3:d:10.1007_s11205-015-1078-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.