IDEAS home Printed from https://ideas.repec.org/a/spr/soinre/v149y2020i3d10.1007_s11205-020-02276-0.html
   My bibliography  Save this article

Quantitative Storytelling in the Making of a Composite Indicator

Author

Listed:
  • Marta Kuc-Czarnecka

    (Gdansk University of Technology)

  • Samuele Lo Piano

    (University of Reading
    Universitat Oberta de Catalunya)

  • Andrea Saltelli

    (Universitat Oberta de Catalunya
    University of Bergen)

Abstract

The reasons for and against composite indicators are briefly reviewed, as well as the available theories for their construction. After noting the strong normative dimension of these measures—which ultimately aim to ‘tell a story’, e.g. to promote the social discovery of a particular phenomenon, we inquire whether a less partisan use of a composite indicator can be proposed by allowing more latitude in the framing of its construction. We thus explore whether a composite indicator can be built to tell ‘more than one story’ and test this in practical contexts. These include measures used in convergence analysis in the field of cohesion policies and a recent case involving the World Bank’s Doing Business Index. Our experiments are built to imagine different constituencies and stakeholders who agree on the use of evidence and of statistical information while differing on the interpretation of what is relevant and vital.

Suggested Citation

  • Marta Kuc-Czarnecka & Samuele Lo Piano & Andrea Saltelli, 2020. "Quantitative Storytelling in the Making of a Composite Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 149(3), pages 775-802, June.
  • Handle: RePEc:spr:soinre:v:149:y:2020:i:3:d:10.1007_s11205-020-02276-0
    DOI: 10.1007/s11205-020-02276-0
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11205-020-02276-0
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11205-020-02276-0?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Mariusz Prochniak & Bartosz Witkowski, 2016. "On The Use Of Panel Stationarity Tests In Convergence Analysis: Empirical Evidence For The Eu Countries," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 11(1), pages 77-96, March.
    3. Hanna Kruk & Anetta Wasniewska, 2017. "Application of the Perkal method for assessing competitiveness of the countries of Central and Eastern Europe," Oeconomia Copernicana, Institute of Economic Research, vol. 8(3), pages 337-352, September.
    4. Paul M. Romer, 2015. "Mathiness in the Theory of Economic Growth," American Economic Review, American Economic Association, vol. 105(5), pages 89-93, May.
    5. Elzbieta Rogalska, 2018. "Multiple-criteria analysis of regional entrepreneurship conditions in Poland," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 13(4), pages 707-723, December.
    6. Marco Marozzi, 2015. "Measuring Trust in European Public Institutions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 123(3), pages 879-895, September.
    7. Stefania Capecchi & Rosaria Simone, 2019. "A Proposal for a Model-Based Composite Indicator: Experience on Perceived Discrimination in Europe," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 95-110, January.
    8. repec:pes:ierequ:v:11:y:2016:i:4:p:25-41 is not listed on IDEAS
    9. Dinis, Gorete & Costa, Carlos & Pacheco, Osvaldo, 2019. "Composite Indicator for measuring the world interest by Portugal’s Tourism," Journal of Spatial and Organizational Dynamics, Cinturs - Research Centre for Tourism, Sustainability and Well-being, University of Algarve, vol. 7(1), pages 39-52.
    10. Pinheiro-Alves, Ricardo & Zambujal-Oliveira, João, 2012. "The Ease of Doing Business Index as a tool for investment location decisions," Economics Letters, Elsevier, vol. 117(1), pages 66-70.
    11. Juan Aparicio & Magdalena Kapelko, 2019. "Enhancing the Measurement of Composite Indicators of Corporate Social Performance," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 807-826, July.
    12. Efthymios Tsionas, 2002. "Another Look at Regional Convergence in Greece," Regional Studies, Taylor & Francis Journals, vol. 36(6), pages 603-609.
    13. Agnieszka Malkowska & Michal Gluszak, 2016. "Pro-Investment Local Policies In The Area Of Real Estate Economics – Similarities And Differences In The Strategies Used By Communes," Oeconomia Copernicana, Institute of Economic Research, vol. 7(2), pages 269-283, June.
    14. Christopher Barrington-Leigh & Alice Escande, 2018. "Measuring Progress and Well-Being: A Comparative Review of Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 135(3), pages 893-925, February.
    15. G. E. Boyle & T. G. McCARTHY, 1999. "Simple measures of convergence in per capita GDP: a note on some further international evidence," Applied Economics Letters, Taylor & Francis Journals, vol. 6(6), pages 343-347.
    16. Talita Greyling & Fiona Tregenna, 2017. "Construction and Analysis of a Composite Quality of Life Index for a Region of South Africa," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 131(3), pages 887-930, April.
    17. Marta Kuc, 2017. "Social Convergence In Nordic Countries At Regional Level," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 12(1), pages 25-41, March.
    18. Katarzyna Cheba & Katarzyna Szopik-Depczyñska, 2017. "Multidimensional comparative analysis of the competitive capacity of the European Union countries and geographical regions," Oeconomia Copernicana, Institute of Economic Research, vol. 8(4), pages 487-504, December.
    19. John Mann & David Shideler, 2015. "Measuring Schumpeterian activity using a composite indicator," Journal of Entrepreneurship and Public Policy, Emerald Group Publishing, vol. 4(1), pages 57-84, April.
    20. Lars Carlsen & Rainer Bruggemann, 2017. "Fragile State Index: Trends and Developments. A Partial Order Data Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 133(1), pages 1-14, August.
    21. Kjell Hausken & John F. Moxnes, 2019. "Innovation, Development and National Indices," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(3), pages 1165-1188, February.
    22. repec:pes:ierequ:v:11:y:2016:i:4:p:43-62 is not listed on IDEAS
    23. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    24. Funtowicz, Silvio O. & Ravetz, Jerome R., 1994. "The worth of a songbird: ecological economics as a post-normal science," Ecological Economics, Elsevier, vol. 10(3), pages 197-207, August.
    25. repec:pes:ieroec:v:8:y:2017:i:3:p:417-431 is not listed on IDEAS
    26. Lars Carlsen & Rainer Bruggemann, 2014. "The ‘Failed State Index’ Offers More than Just a Simple Ranking," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 115(1), pages 525-530, January.
    27. Natalia Bartkowiak-Bakun, 2017. "The diversity of socioeconomic development of rural areas in Poland in The Western Borderland and the problem of post-state farm localities," Oeconomia Copernicana, Institute of Economic Research, vol. 8(3), pages 417-432, September.
    28. Siddharth Sareen & Andrea Saltelli & Kjetil Rommetveit, 2020. "Ethics of quantification: illumination, obfuscation and performative legitimation," Palgrave Communications, Palgrave Macmillan, vol. 6(1), pages 1-5, December.
    29. Høyland, Bjørn & Moene, Karl & Willumsen, Fredrik, 2012. "The tyranny of international index rankings," Journal of Development Economics, Elsevier, vol. 97(1), pages 1-14.
    30. Inna Semenenko & Ruslan Halhash & Kseniia Sieriebriak, 2019. "Sustainable development of regions in Ukraine: before and after the beginning of the conflict," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 14(2), pages 317-339, June.
    31. Michener, Gregory, 2015. "Policy Evaluation via Composite Indexes: Qualitative Lessons from International Transparency Policy Indexes," World Development, Elsevier, vol. 74(C), pages 184-196.
    32. Rafal Zelazny & Jacek Pietrucha, 2017. "Measuring Innovation And Institution: The Creative Economy Index," Equilibrium. Quarterly Journal of Economics and Economic Policy, Institute of Economic Research, vol. 12(1), pages 43-62, March.
    33. Jad Chaaban & Alexandra Irani & Alexander Khoury, 2016. "The Composite Global Well-Being Index (CGWBI): A New Multi-Dimensional Measure of Human Development," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(1), pages 465-487, October.
    34. Michelle Baddeley, 2006. "Convergence or Divergence? The Impacts of Globalisation on Growth and Inequality in Less Developed Countries," International Review of Applied Economics, Taylor & Francis Journals, vol. 20(3), pages 391-410.
    35. Natalia Bartkowiak-Bakun, 2017. "The Diversity Of Socioeconomic Development Of Rural AreasIn The Western Borderland And The Problem Of Post-State Farm Localities," Working Papers 10/2017, Institute of Economic Research, revised May 2017.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Renner, Ansel & Cadillo-Benalcazar, Juan José & Benini, Lorenzo & Giampietro, Mario, 2020. "Environmental pressure of the European agricultural system: Anticipating the biophysical consequences of internalization," Ecosystem Services, Elsevier, vol. 46(C).
    2. Carlo Drago, 2021. "The Analysis and the Measurement of Poverty: An Interval-Based Composite Indicator Approach," Economies, MDPI, vol. 9(4), pages 1-17, October.
    3. María Cascales Mira, 2021. "New Model for Measuring Job Quality: Developing an European Intrinsic Job Quality Index (EIJQI)," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(2), pages 625-645, June.
    4. Marlena Piekut, 2021. "Between Poverty and Energy Satisfaction in Polish Households Run by People Aged 60 and Older," Energies, MDPI, vol. 14(19), pages 1-30, September.
    5. Bacchini Fabio & Baldazzi Barbara & De Carli Rita & Di Biagio Lorenzo & Savioli Miria & Sorvillo Maria Pia & Tinto Alessandra, 2021. "The Evolution of the Italian Framework to Measure Well-Being," Journal of Official Statistics, Sciendo, vol. 37(2), pages 317-339, June.
    6. Clea Beatriz Macagnan & Rosane Maria Seibert, 2021. "Sustainability Indicators: Information Asymmetry Mitigators between Cooperative Organizations and Their Primary Stakeholders," Sustainability, MDPI, vol. 13(15), pages 1-16, July.
    7. Aleksandras Krylovas & Natalja Kosareva & Stanislav Dadelo, 2020. "European Countries Ranking and Clustering Solution by Children’s Physical Activity and Human Development Index Using Entropy-Based Methods," Mathematics, MDPI, vol. 8(10), pages 1-22, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    2. Chao Shi & Kenneth C. Land, 0. "The Data Envelopment Analysis and Equal Weights/Minimax Methods of Composite Social Indicator Construction: a Methodological Study of Data Sensitivity and Robustness," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 0, pages 1-28.
    3. Chao Shi & Kenneth C. Land, 2021. "The Data Envelopment Analysis and Equal Weights/Minimax Methods of Composite Social Indicator Construction: a Methodological Study of Data Sensitivity and Robustness," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 16(4), pages 1689-1716, August.
    4. Annamaria Bianchi & Silvia Biffignandi, 0. "Workplace Social Environment Indicator: A Comparative Analysis of European Regions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 0, pages 1-20.
    5. Biggeri, Mario & Clark, David A. & Ferrannini, Andrea & Mauro, Vincenzo, 2019. "Tracking the SDGs in an ‘integrated’ manner: A proposal for a new index to capture synergies and trade-offs between and within goals," World Development, Elsevier, vol. 122(C), pages 628-647.
    6. Aleksandra Maksimovska & Aleksandar Stojkov, 2019. "Composite Indicator of Social Responsiveness of Local Governments: An Empirical Mapping of the Networked Community Governance Paradigm," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 669-706, July.
    7. Natalia Bartkowiak-Bakun & Luiza Ossowska & Dorota Janiszewska & Grzegorz Kwiatkowski, 2020. "Agricultural and Tourist Functions in Rural Areas and the Level of Local Development: The Case of Poland," European Research Studies Journal, European Research Studies Journal, vol. 0(Special 2), pages 985-995.
    8. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    9. Marco Marozzi & Mario Bolzan, 2018. "An Index of Household Accessibility to Basic Services: A Study of Italian Regions," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 136(3), pages 1237-1250, April.
    10. Rachel M. Gisselquist, 2013. "Evaluating Governance Indexes: Critical and Less Critical Questions," WIDER Working Paper Series wp-2013-068, World Institute for Development Economic Research (UNU-WIDER).
    11. Ludger Niemann & Thomas Hoppe, 2021. "How to Sustain Sustainability Monitoring in Cities: Lessons from 49 Community Indicator Initiatives across 10 Latin American Countries," Sustainability, MDPI, vol. 13(9), pages 1-16, May.
    12. Raquel Lourenço Carvalhal Monteiro & Valdecy Pereira & Helder Gomes Costa, 2019. "Analysis of the Better Life Index Trough a Cluster Algorithm," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 142(2), pages 477-506, April.
    13. Edson Kogachi & Adonias Ferreira & Carlos Cavalcante & Marcelo Embiruçu, 2021. "Development of Performance Evaluation Indicators for Table Grape Packaging Units. 2. Global Indexes," Sustainability, MDPI, vol. 13(11), pages 1-16, June.
    14. Gisselquist, Rachel M., 2013. "Evaluating Governance Indexes: Critical and Less Critical Questions," WIDER Working Paper Series 068, World Institute for Development Economic Research (UNU-WIDER).
    15. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    16. Giuseppe Coco & Raffaele Lagravinese & Giuliano Resce, 2020. "Beyond the weights: a multicriteria approach to evaluate inequality in education," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 18(4), pages 469-489, December.
    17. Carlo Drago, 2021. "The Analysis and the Measurement of Poverty: An Interval-Based Composite Indicator Approach," Economies, MDPI, vol. 9(4), pages 1-17, October.
    18. Carrillo, Marianela & Jorge, Jesús M., 2017. "Multidimensional Analysis of Regional Tourism Sustainability in Spain," Ecological Economics, Elsevier, vol. 140(C), pages 89-98.
    19. Dorota Weziak-Bialowolska, 2016. "Spatial Variation in EU Poverty with Respect to Health, Education and Living Standards," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 125(2), pages 451-479, January.
    20. Anna Matysiak & Dorota Węziak-Białowolska, 2016. "Country-Specific Conditions for Work and Family Reconciliation: An Attempt at Quantification," European Journal of Population, Springer;European Association for Population Studies, vol. 32(4), pages 475-510, October.

    More about this item

    Keywords

    Composite indicator; International comparison; Quantitative storytelling; Social convergence;
    All these keywords.

    JEL classification:

    • C43 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Index Numbers and Aggregation
    • C38 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables - - - Classification Methdos; Cluster Analysis; Principal Components; Factor Analysis
    • O1 - Economic Development, Innovation, Technological Change, and Growth - - Economic Development

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:soinre:v:149:y:2020:i:3:d:10.1007_s11205-020-02276-0. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: . General contact details of provider: http://www.springer.com .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.