IDEAS home Printed from https://ideas.repec.org/p/fem/femwpa/2015.13.html
   My bibliography  Save this paper

Revisiting Worst-case DEA for Composite Indicators

Author

Listed:
  • Stergios Athanassoglou

    (European Commission Joint Research Center)

Abstract

Composite indicators are becoming increasingly infuential tools of environmental assessment and advocacy. Nonetheless, their use is controversial as they often rely on ad-hoc and theoretically problematic assumptions regarding normalization, aggregation, and weighting. Nonparametric data envelopment analysis (DEA) methods, originating in the production economics literature, have been proposed as a means of addressing these concerns. These methods dispense with contentious normalization and weighting techniques by focusing on a measure of best-case relative performance. Recently, the standard DEA model for composite indicators was extended to account for worst-case analysis by Zhou, Ang, and Poh [21] (hereafter, ZAP). In this note we argue that, while valid and interesting in its own right, the measure adopted by ZAP may not capture, in a mathematical as well as practical sense, the notion of worst-case relative performance. By contrast, we focus on the strict worst case analogue of standard DEA for composite indicators and show how it leads to tractable optimization problems. Finally, we compare the two methodologies using data from ZAP's Sustainable Energy Index case study, demonstrating that they occasionally lead to divergent results.

Suggested Citation

  • Stergios Athanassoglou, 2015. "Revisiting Worst-case DEA for Composite Indicators," Working Papers 2015.13, Fondazione Eni Enrico Mattei.
  • Handle: RePEc:fem:femwpa:2015.13
    as

    Download full text from publisher

    File URL: https://feem-media.s3.eu-central-1.amazonaws.com/wp-content/uploads/NDL2015-013.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Bohringer, Christoph & Jochem, Patrick E.P., 2007. "Measuring the immeasurable -- A survey of sustainability indices," Ecological Economics, Elsevier, vol. 63(1), pages 1-8, June.
    2. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    3. Martin Ravallion, 2012. "Mashup Indices of Development," The World Bank Research Observer, World Bank, vol. 27(1), pages 1-32, February.
    4. Charnes, A. & Cooper, W. W. & Rhodes, E., 1978. "Measuring the efficiency of decision making units," European Journal of Operational Research, Elsevier, vol. 2(6), pages 429-444, November.
    5. Anderson, Gordon & Crawford, Ian & Leicester, Andrew, 2011. "Welfare rankings from multivariate data, a nonparametric approach," Journal of Public Economics, Elsevier, vol. 95(3), pages 247-252.
    6. Zaim, Osman, 2004. "Measuring environmental performance of state manufacturing through changes in pollution intensities: a DEA framework," Ecological Economics, Elsevier, vol. 48(1), pages 37-47, January.
    7. Ravallion, Martin, 2012. "Troubling tradeoffs in the Human Development Index," Journal of Development Economics, Elsevier, vol. 99(2), pages 201-209.
    8. Rogge, Nicky, 2012. "Undesirable specialization in the construction of composite policy indicators: The Environmental Performance Index," Working Papers 2012/08, Hogeschool-Universiteit Brussel, Faculteit Economie en Management.
    9. Zhang, Hai-Ying & Ji, Qiang & Fan, Ying, 2013. "An evaluation framework for oil import security based on the supply chain with a case study focused on China," Energy Economics, Elsevier, vol. 38(C), pages 87-95.
    10. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    11. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    12. Ebert, Udo & Welsch, Heinz, 2004. "Meaningful environmental indices: a social choice approach," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 270-283, March.
    13. Fare, R. & Grosskopf, S. & Hernandez-Sancho, F., 2004. "Environmental performance: an index number approach," Resource and Energy Economics, Elsevier, vol. 26(4), pages 343-352, December.
    14. Zhu, Joe, 2004. "A buyer-seller game model for selection and negotiation of purchasing bids: Extensions and new models," European Journal of Operational Research, Elsevier, vol. 154(1), pages 150-156, April.
    15. Cherchye, Laurens & Knox Lovell, C.A. & Moesen, Wim & Van Puyenbroeck, Tom, 2007. "One market, one number? A composite indicator assessment of EU internal market dynamics," European Economic Review, Elsevier, vol. 51(3), pages 749-779, April.
    16. Laurens Cherchye & Willem Moesen & Nicky Rogge & Tom Puyenbroeck, 2007. "An Introduction to ‘Benefit of the Doubt’ Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 82(1), pages 111-145, May.
    17. Mónica Domínguez-Serrano & Francisco Blancas, 2011. "A Gender Wellbeing Composite Indicator: The Best-Worst Global Evaluation Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 102(3), pages 477-496, July.
    18. William W. Cooper & Lawrence M. Seiford & Kaoru Tone, 2007. "Data Envelopment Analysis," Springer Books, Springer, edition 0, number 978-0-387-45283-8, December.
    19. Takamura, Yoshiharu & Tone, Kaoru, 2003. "A comparative site evaluation study for relocating Japanese government agencies out of Tokyo," Socio-Economic Planning Sciences, Elsevier, vol. 37(2), pages 85-102, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Gulati, Rachita & Kattumuri, Ruth & Kumar, Sunil, 2020. "A non-parametric index of corporate governance in the banking industry: An application to Indian data," Socio-Economic Planning Sciences, Elsevier, vol. 70(C).
    2. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    3. L. P. Zhang & P. Zhou, 2019. "Reassessment of global climate risk: non-compensatory or compensatory?," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 95(1), pages 271-287, January.
    4. Tom Puyenbroeck, 2018. "On the Output Orientation of the Benefit-of-the-Doubt-Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(2), pages 415-431, September.
    5. Ziwei Shu & Ramón Alberto Carrasco & Javier Portela García-Miguel & Manuel Sánchez-Montañés, 2022. "Multiple Scenarios of Quality of Life Index Using Fuzzy Linguistic Quantifiers: The Case of 85 Countries in Numbeo," Mathematics, MDPI, vol. 10(12), pages 1-28, June.
    6. Pinar, Mehmet & Stengos, Thanasis & Topaloglou, Nikolas, 2020. "On the construction of a feasible range of multidimensional poverty under benchmark weight uncertainty," European Journal of Operational Research, Elsevier, vol. 281(2), pages 415-427.
    7. Rogge, Nicky & De Jaeger, Simon & Lavigne, Carolien, 2017. "Waste Performance of NUTS 2-regions in the EU: A Conditional Directional Distance Benefit-of-the-Doubt Model," Ecological Economics, Elsevier, vol. 139(C), pages 19-32.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Stergios Athanassoglou, 2016. "Revisiting Worst-Case DEA for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 128(3), pages 1259-1272, September.
    2. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    3. Rogge, Nicky, 2018. "Composite indicators as generalized benefit-of-the-doubt weighted averages," European Journal of Operational Research, Elsevier, vol. 267(1), pages 381-392.
    4. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    5. Verbunt, Pim & Rogge, Nicky, 2018. "Geometric composite indicators with compromise Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 264(1), pages 388-401.
    6. Kortelainen, Mika, 2008. "Dynamic environmental performance analysis: A Malmquist index approach," Ecological Economics, Elsevier, vol. 64(4), pages 701-715, February.
    7. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    8. Yongjun Shen & Elke Hermans & Tom Brijs & Geert Wets, 2013. "Data Envelopment Analysis for Composite Indicators: A Multiple Layer Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(2), pages 739-756, November.
    9. Blancard, Stéphane & Hoarau, Jean-François, 2013. "A new sustainable human development indicator for small island developing states: A reappraisal from data envelopment analysis," Economic Modelling, Elsevier, vol. 30(C), pages 623-635.
    10. P. Zhou & B. Ang, 2009. "Comparing MCDA Aggregation Methods in Constructing Composite Indicators Using the Shannon-Spearman Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(1), pages 83-96, October.
    11. Ernest Reig-Martínez, 2013. "Social and Economic Wellbeing in Europe and the Mediterranean Basin: Building an Enlarged Human Development Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 111(2), pages 527-547, April.
    12. Fusco, Elisa & Maggi, Bernardo & Rizzuto, Livia, 2022. "Alternative indicators for the evaluation of renewables in Europe: An efficiency approach," Renewable Energy, Elsevier, vol. 190(C), pages 48-65.
    13. Fu-Chiang Yang & Rui-Hsin Kao & Yi-Tui Chen & Yueh-Fei Ho & Cheng-Chung Cho & Shi-Wei Huang, 2018. "A Common Weight Approach to Construct Composite Indicators: The Evaluation of Fourteen Emerging Markets," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 137(2), pages 463-479, June.
    14. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    15. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    16. Amado, Carla A.F. & São José, José M.S. & Santos, Sérgio P., 2016. "Measuring active ageing: A Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 255(1), pages 207-223.
    17. Lampe, Hannes W. & Hilgers, Dennis, 2015. "Trajectories of efficiency measurement: A bibliometric analysis of DEA and SFA," European Journal of Operational Research, Elsevier, vol. 240(1), pages 1-21.
    18. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    19. Jorge Guardiola & Andrés J. Picazo-Tadeo, 2013. "Weighting life domains with Data Envelopment Analysis," Working Papers 1311, Department of Applied Economics II, Universidad de Valencia.
    20. Kristof Witte & Nicky Rogge, 2010. "To publish or not to publish? On the aggregation and drivers of research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 85(3), pages 657-680, December.

    More about this item

    Keywords

    Composite Indicator; Sustainability Index; DEA; Worst-case; Convex Optimization;
    All these keywords.

    JEL classification:

    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • C44 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Operations Research; Statistical Decision Theory
    • Q00 - Agricultural and Natural Resource Economics; Environmental and Ecological Economics - - General - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fem:femwpa:2015.13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Alberto Prina Cerai (email available below). General contact details of provider: https://edirc.repec.org/data/feemmit.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.