IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v149y2020i1d10.1007_s11205-019-02236-3.html
   My bibliography  Save this article

Constructing Composite Indicators with Individual Judgements and Best–Worst Method: An Illustration of Value Measure

Author

Listed:
  • Tianjiao Wang

    (University of Science and Technology of China)

  • Yelin Fu

    (Shenzhen University
    Department of Industrial and Manufacturing Systems Engineering)

Abstract

In practice, a variety of composite indicators are created using the arithmetic average of different sub-indicators. However, this scheme is typically criticized of the possibility of compensation. For this reason, this paper re-constructs these composite indicators by means of a new methodology. Comprehensive individual judgements among the sub-indicators have been considered to determine the maximum total utilities. Then the best–worst method is introduced to determine the preference associated with various individual judgements. An illustration of Value Measure of health systems is presented to demonstrate the validity and usefulness of our methodology.

Suggested Citation

  • Tianjiao Wang & Yelin Fu, 2020. "Constructing Composite Indicators with Individual Judgements and Best–Worst Method: An Illustration of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(1), pages 1-14, May.
    • Handle: RePEc:spr:soinre:v:149:y:2020:i:1:d:10.1007_s11205-019-02236-3
    DOI: 10.1007/s11205-019-02236-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-019-02236-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11205-019-02236-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Luzzati, T. & Gucciardi, G., 2015. "A non-simplistic approach to composite indicators and rankings: an illustration by comparing the sustainability of the EU Countries," Ecological Economics, Elsevier, vol. 113(C), pages 25-38.
    2. Zhou, P. & Ang, B.W. & Poh, K.L., 2006. "Comparing aggregating methods for constructing the composite environmental index: An objective measure," Ecological Economics, Elsevier, vol. 59(3), pages 305-311, September.
    3. Ebert, Udo & Welsch, Heinz, 2004. "Meaningful environmental indices: a social choice approach," Journal of Environmental Economics and Management, Elsevier, vol. 47(2), pages 270-283, March.
    4. Wang, H., 2015. "A generalized MCDA–DEA (multi-criterion decision analysis–data envelopment analysis) approach to construct slacks-based composite indicator," Energy, Elsevier, vol. 80(C), pages 114-122.
    5. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    6. Michela Nardo & Michaela Saisana & Andrea Saltelli & Stefano Tarantola & Anders Hoffman & Enrico Giovannini, 2005. "Handbook on Constructing Composite Indicators: Methodology and User Guide," OECD Statistics Working Papers 2005/3, OECD Publishing.
    7. Giuseppe Munda, 2012. "Choosing Aggregation Rules for Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 109(3), pages 337-354, December.
    8. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    9. Badea, Anca Costescu & Rocco S., Claudio M. & Tarantola, Stefano & Bolado, Ricardo, 2011. "Composite indicators for security of energy supply using ordered weighted averaging," Reliability Engineering and System Safety, Elsevier, vol. 96(6), pages 651-662.
    10. Thomas L. Saaty, 1986. "Axiomatic Foundation of the Analytic Hierarchy Process," Management Science, INFORMS, vol. 32(7), pages 841-855, July.
    11. Yang Ding & Yelin Fu & Kin Keung Lai & W. K. John Leung, 2018. "Using Ranked Weights and Acceptability Analysis to Construct Composite Indicators: A Case Study of Regional Sustainable Society Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(3), pages 871-885, October.
    12. Robert F. Bordley, 1982. "A Multiplicative Formula for Aggregating Probability Assessments," Management Science, INFORMS, vol. 28(10), pages 1137-1148, October.
    13. Giannis Karagiannis, 2017. "On aggregate composite indicators," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 68(7), pages 741-746, July.
    14. Peter A. Morris, 1977. "Combining Expert Judgments: A Bayesian Approach," Management Science, INFORMS, vol. 23(7), pages 679-693, March.
    15. Song, Lianlian & Fu, Yelin & Zhou, Peng & Lai, Kin Keung, 2017. "Measuring national energy performance via Energy Trilemma Index: A Stochastic Multicriteria Acceptability Analysis," Energy Economics, Elsevier, vol. 66(C), pages 313-319.
    16. Zhang, L.P. & Zhou, P., 2018. "A non-compensatory composite indicator approach to assessing low-carbon performance," European Journal of Operational Research, Elsevier, vol. 270(1), pages 352-361.
    17. Michela Gnaldi & Simone Del Sarto, 2018. "Variable Weighting via Multidimensional IRT Models in Composite Indicators Construction," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(3), pages 1139-1156, April.
    18. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    19. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    20. S-K Lee & J-H Yu, 2013. "Composite indicator development using utility function and fuzzy theory," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 64(8), pages 1279-1290, August.
    21. Zhou, P. & Ang, B.W. & Poh, K.L., 2007. "A mathematical programming approach to constructing composite indicators," Ecological Economics, Elsevier, vol. 62(2), pages 291-297, April.
    22. Zhou, P. & Delmas, M.A. & Kohli, A., 2017. "Constructing meaningful environmental indices: A nonparametric frontier approach," Journal of Environmental Economics and Management, Elsevier, vol. 85(C), pages 21-34.
    23. Rezaei, Jafar, 2016. "Best-worst multi-criteria decision-making method: Some properties and a linear model," Omega, Elsevier, vol. 64(C), pages 126-130.
    24. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    25. Yongjun Shen & Elke Hermans & Tom Brijs & Geert Wets, 2013. "Data Envelopment Analysis for Composite Indicators: A Multiple Layer Model," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 114(2), pages 739-756, November.
    26. Verbunt, Pim & Rogge, Nicky, 2018. "Geometric composite indicators with compromise Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 264(1), pages 388-401.
    27. P. Zhou & B. Ang, 2009. "Comparing MCDA Aggregation Methods in Constructing Composite Indicators Using the Shannon-Spearman Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(1), pages 83-96, October.
    28. Oscar Claveria & Enric Monte & Salvador Torra, 2018. "A Data-Driven Approach to Construct Survey-Based Indicators by Means of Evolutionary Algorithms," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(1), pages 1-14, January.
    29. Natale Carlo Lauro & Maria Gabriella Grassia & Rosanna Cataldo, 2018. "Model Based Composite Indicators: New Developments in Partial Least Squares-Path Modeling for the Building of Different Types of Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(2), pages 421-455, January.
    30. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    31. Fusco, Elisa, 2015. "Enhancing non-compensatory composite indicators: A directional proposal," European Journal of Operational Research, Elsevier, vol. 242(2), pages 620-630.
    32. F. Hutton Barron & Bruce E. Barrett, 1996. "Decision Quality Using Ranked Attribute Weights," Management Science, INFORMS, vol. 42(11), pages 1515-1523, November.
    33. Dorit S. Hochbaum & Asaf Levin, 2006. "Methodologies and Algorithms for Group-Rankings Decision," Management Science, INFORMS, vol. 52(9), pages 1394-1408, September.
    34. Cheng Peng & Xunbo Wu & Yelin Fu & Kin Keung Lai, 2017. "Alternative approaches to constructing composite indicators: an application to construct a Sustainable Energy Index for APEC economies," Operational Research, Springer, vol. 17(3), pages 747-759, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yelin Fu & Kong Xiangtianrui & Hao Luo & Lean Yu, 2020. "Constructing Composite Indicators with Collective Choice and Interval-Valued TOPSIS: The Case of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(1), pages 117-135, November.
    2. Vineet Kaushik & Shobha Tewari, 2023. "Modeling Opportunity Indicators Fostering Social Entrepreneurship: A Hybrid Delphi and Best-Worst Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 168(1), pages 667-698, August.
    3. José-Miguel Bello y Villarino, 2021. "Measuring Corruption: A Critical Analysis of the Existing Datasets and Their Suitability for Diachronic Transnational Research," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 709-747, September.
    4. Justin Ehrlich & Simon Medcalfe & Shane Sanders, 2021. "Composite Index Ranking of Economic Well-Being in U.S. Metropolitan Areas: How Prevalent are Rank Anomalies?," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 157(2), pages 543-562, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yelin Fu & Kong Xiangtianrui & Hao Luo & Lean Yu, 2020. "Constructing Composite Indicators with Collective Choice and Interval-Valued TOPSIS: The Case of Value Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(1), pages 117-135, November.
    2. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    3. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    4. Yang Ding & Yelin Fu & Kin Keung Lai & W. K. John Leung, 2018. "Using Ranked Weights and Acceptability Analysis to Construct Composite Indicators: A Case Study of Regional Sustainable Society Index," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 139(3), pages 871-885, October.
    5. Zhang, L.P. & Zhou, P., 2018. "A non-compensatory composite indicator approach to assessing low-carbon performance," European Journal of Operational Research, Elsevier, vol. 270(1), pages 352-361.
    6. Ju, Keyi & Su, Bin & Zhou, Dequn & Zhou, P. & Zhang, Yuqiang, 2015. "Oil price crisis response: Capability assessment and key indicator identification," Energy, Elsevier, vol. 93(P2), pages 1353-1360.
    7. Giménez, Víctor & Thieme, Claudio & Prior, Diego & Tortosa-Ausina, Emili, 2022. "Evaluation and determinants of preschool effectiveness in Chile," Socio-Economic Planning Sciences, Elsevier, vol. 81(C).
    8. P. Zhou & B. Ang & D. Zhou, 2010. "Weighting and Aggregation in Composite Indicator Construction: a Multiplicative Optimization Approach," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 96(1), pages 169-181, March.
    9. L. P. Zhang & P. Zhou, 2019. "Reassessment of global climate risk: non-compensatory or compensatory?," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 95(1), pages 271-287, January.
    10. Yuan, Qianqian & Fang Chin Cheng, Charles & Wang, Jiayu & Zhu, Tian-Tian & Wang, Ke, 2020. "Inclusive and sustainable industrial development in China: An efficiency-based analysis for current status and improving potentials," Applied Energy, Elsevier, vol. 268(C).
    11. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    12. Van Puyenbroeck, Tom & Rogge, Nicky, 2017. "Geometric mean quantity index numbers with Benefit-of-the-Doubt weights," European Journal of Operational Research, Elsevier, vol. 256(3), pages 1004-1014.
    13. Zhou, P. & Wang, M., 2016. "Carbon dioxide emissions allocation: A review," Ecological Economics, Elsevier, vol. 125(C), pages 47-59.
    14. Annalina Sarra & Eugenia Nissi, 2020. "A Spatial Composite Indicator for Human and Ecosystem Well-Being in the Italian Urban Areas," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 148(2), pages 353-377, April.
    15. P. Zhou & B. Ang, 2009. "Comparing MCDA Aggregation Methods in Constructing Composite Indicators Using the Shannon-Spearman Measure," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 94(1), pages 83-96, October.
    16. Lozano-Oyola, Macarena & Contreras, Ignacio & Blancas, Francisco Javier, 2019. "An Operational Non-compensatory Composite Indicator: Measuring Sustainable Tourism in Andalusian Urban Destinations," Ecological Economics, Elsevier, vol. 159(C), pages 1-10.
    17. Hatefi, S.M. & Torabi, S.A., 2010. "A common weight MCDA-DEA approach to construct composite indicators," Ecological Economics, Elsevier, vol. 70(1), pages 114-120, November.
    18. M. M. Segovia-González & I. Contreras, 2023. "A Composite Indicator to Compare the Performance of Male and Female Students in Educational Systems," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 165(1), pages 181-212, January.
    19. Vidoli, F.; & Fusco, E.; & Pignataro, G.; & Guccio, C.;, 2023. "Multi-directional Robust Benefit of the Doubt model: a comprehensive measure for the quality of health care in OECD countries," Health, Econometrics and Data Group (HEDG) Working Papers 23/14, HEDG, c/o Department of Economics, University of York.
    20. Riccardo Natoli & Segu Zuhair, 2011. "Measuring Progress: A Comparison of the GDP, HDI, GS and the RIE," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 103(1), pages 33-56, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:149:y:2020:i:1:d:10.1007_s11205-019-02236-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.