IDEAS home Printed from https://ideas.repec.org/a/eee/ejores/v288y2021i2p584-597.html
   My bibliography  Save this article

Benchmarking culture in Europe: A data envelopment analysis approach to identify city-specific strengths

Author

Listed:
  • Van Puyenbroeck, Tom
  • Montalto, Valentina
  • Saisana, Michaela

Abstract

Culture is an integral part of a city's quality of life, a driver of urban change, and a genuine economic sector. To support benchmarking of urban culture and facilitate peer learning amongst policymakers, the European Commission has recently created the ‘Cultural and Creative Cities Index’. While this index builds on a standardised method to aggregate 29 indicators for the 155 selected cities, it is explicitly acknowledged that a ‘gold standard’ for a ‘Cultural and Creative City’ does not exist. Instead, different approaches should be allowed for in capturing cities’ cultural and creative vitality. This is the point of departure for this paper, which employs a Benefit-of-the-Doubt (BoD) modelling approach to allow cities to combine such respect for performance diversity with peer learning and benchmarking. Expert-based weights are used to provide expert-consistent bounds for the shares of key dimensions in a city's final BoD index value. We identify three city clusters, amongst which there are large performance differences. Accordingly, we focus on the within-group identification of peer cities and target values, which we illustrate in more detail for Bilbao, Krakόw and Umeå, towards the formulation of fit-for-purpose policy measures that can support culture-led development.

Suggested Citation

  • Van Puyenbroeck, Tom & Montalto, Valentina & Saisana, Michaela, 2021. "Benchmarking culture in Europe: A data envelopment analysis approach to identify city-specific strengths," European Journal of Operational Research, Elsevier, vol. 288(2), pages 584-597.
  • Handle: RePEc:eee:ejores:v:288:y:2021:i:2:p:584-597
    DOI: 10.1016/j.ejor.2020.05.058
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0377221720305191
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.ejor.2020.05.058?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Paolo Paruolo & Michaela Saisana & Andrea Saltelli, 2013. "Ratings and rankings: voodoo or science?," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 176(3), pages 609-634, June.
    2. Walter Santagata, 2002. "Cultural districts, property rights, and sustainable economic growth," Others 0210004, University Library of Munich, Germany.
    3. Per Andersen & Niels Christian Petersen, 1993. "A Procedure for Ranking Efficient Units in Data Envelopment Analysis," Management Science, INFORMS, vol. 39(10), pages 1261-1264, October.
    4. Frank Oort, 2008. "Philip Cooke and Luciana Lazzeretti (eds): Creative Cities, Cultural Clusters and Local Economic Development," Journal of Cultural Economics, Springer;The Association for Cultural Economics International, vol. 32(3), pages 237-240, September.
    5. Sarrico, C. S. & Dyson, R. G., 2004. "Restricting virtual weights in data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 159(1), pages 17-34, November.
    6. Lovell, C. A. Knox & Pastor, Jesus T., 1999. "Radial DEA models without inputs or without outputs," European Journal of Operational Research, Elsevier, vol. 118(1), pages 46-51, October.
    7. Jason Potts, 2009. "Why creative industries matter to economic evolution," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 18(7), pages 663-673.
    8. Walter Santagata, 2002. "Cultural Districts, Property Rights and Sustainable Economic Growth," International Journal of Urban and Regional Research, Wiley Blackwell, vol. 26(1), pages 9-23, March.
    9. Verschelde, Marijn & Rogge, Nicky, 2012. "An environment-adjusted evaluation of citizen satisfaction with local police effectiveness: Evidence from a conditional Data Envelopment Analysis approach," European Journal of Operational Research, Elsevier, vol. 223(1), pages 214-225.
    10. Gasser, Patrick, 2020. "A review on energy security indices to compare country performances," Energy Policy, Elsevier, vol. 139(C).
    11. Karagiannis, Roxani & Karagiannis, Giannis, 2018. "Intra- and inter-group composite indicators using the BoD model," Socio-Economic Planning Sciences, Elsevier, vol. 61(C), pages 44-51.
    12. L Cherchye & W Moesen & N Rogge & T Van Puyenbroeck & M Saisana & A Saltelli & R Liska & S Tarantola, 2008. "Creating composite indicators with DEA and robustness analysis: the case of the Technology Achievement Index," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 59(2), pages 239-251, February.
    13. Andrea Saltelli, 2007. "Composite Indicators between Analysis and Advocacy," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 81(1), pages 65-77, March.
    14. Pastor, J. T. & Ruiz, J. L. & Sirvent, I., 1999. "An enhanced DEA Russell graph efficiency measure," European Journal of Operational Research, Elsevier, vol. 115(3), pages 596-607, June.
    15. Richard Smith & Katie Warfield, 2007. "The Creative City: A Matter of Values," Chapters, in: Philip Cooke & Luciana Lazzeretti (ed.), Creative Cities, Cultural Clusters and Local Economic Development, chapter 12, Edward Elgar Publishing.
    16. Zanella, Andreia & Camanho, Ana S. & Dias, Teresa G., 2015. "Undesirable outputs and weighting schemes in composite indicators based on data envelopment analysis," European Journal of Operational Research, Elsevier, vol. 245(2), pages 517-530.
    17. Tondl, Gabriele & Vuksic, Goran, 2003. "What makes regions in Eastern Europe catching up? The role of foreign investment, human resources and geography," ZEI Working Papers B 12-2003, University of Bonn, ZEI - Center for European Integration Studies.
    18. Guido Ferilli & Pier Luigi Sacco & Giorgio Tavano Blessi & Stefano Forbici, 2017. "Power to the people: when culture works as a social catalyst in urban regeneration processes (and when it does not)," European Planning Studies, Taylor & Francis Journals, vol. 25(2), pages 241-258, February.
    19. M. Saisana & A. Saltelli & S. Tarantola, 2005. "Uncertainty and sensitivity analysis techniques as tools for the quality assessment of composite indicators," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 168(2), pages 307-323, March.
    20. Samira El Gibari & Trinidad Gómez & Francisco Ruiz, 2019. "Building composite indicators using multicriteria methods: a review," Journal of Business Economics, Springer, vol. 89(1), pages 1-24, February.
    21. Nam Anh Tran & Gerald Shively & Paul Preckel, 2010. "A new method for detecting outliers in Data Envelopment Analysis," Applied Economics Letters, Taylor & Francis Journals, vol. 17(4), pages 313-316.
    22. Mette Asmild & Fai Tam, 2007. "Estimating global frontier shifts and global Malmquist indices," Journal of Productivity Analysis, Springer, vol. 27(2), pages 137-148, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Vilarinho, Hermilio & D’Inverno, Giovanna & Nóvoa, Henriqueta & Camanho, Ana S., 2023. "The measurement of asset management performance of water companies," Socio-Economic Planning Sciences, Elsevier, vol. 87(PA).
    2. Olegs Krasnopjorovs, 2022. "Ready for the next 820? Looking for the keys to paradise of Riga city," Discussion Papers 2022/02, Latvijas Banka.
    3. Gillian Foster & Ruba Saleh, 2021. "The Adaptive Reuse of Cultural Heritage in European Circular City Plans: A Systematic Review," Sustainability, MDPI, vol. 13(5), pages 1-15, March.
    4. Kalinichenko, Olena & Amado, Carla A.F. & Santos, Sérgio P., 2022. "Exploring the potential of Data Envelopment Analysis for enhancing pay-for-performance programme design in primary health care," European Journal of Operational Research, Elsevier, vol. 298(3), pages 1084-1100.
    5. Mercedes Mareque & Elena de Prada Creo & Marcos Álvarez-Díaz, 2021. "Exploring Creative Tourism Based on the Cultural and Creative Cities (C3) Index and Using Bootstrap Confidence Intervals," Sustainability, MDPI, vol. 13(9), pages 1-17, May.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Salvatore Greco & Alessio Ishizaka & Menelaos Tasiou & Gianpiero Torrisi, 2019. "On the Methodological Framework of Composite Indices: A Review of the Issues of Weighting, Aggregation, and Robustness," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 141(1), pages 61-94, January.
    2. Milica Maricic & Jose A. Egea & Veljko Jeremic, 2019. "A Hybrid Enhanced Scatter Search—Composite I-Distance Indicator (eSS-CIDI) Optimization Approach for Determining Weights Within Composite Indicators," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 144(2), pages 497-537, July.
    3. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2019. "Sigma-Mu efficiency analysis: A methodology for evaluating units through composite indicators," European Journal of Operational Research, Elsevier, vol. 278(3), pages 942-960.
    4. Dovile Stumbriene & Ana S. Camanho & Audrone Jakaitiene, 2020. "The performance of education systems in the light of Europe 2020 strategy," Annals of Operations Research, Springer, vol. 288(2), pages 577-608, May.
    5. Su, Weihua & Chen, Sibo & Zhang, Chonghui & Li, Kevin W., 2023. "A subgroup dominance-based benefit of the doubt method for addressing rank reversals: A case study of the human development index in Europe," European Journal of Operational Research, Elsevier, vol. 307(3), pages 1299-1317.
    6. Giuseppe Coco & Raffaele Lagravinese & Giuliano Resce, 2020. "Beyond the weights: a multicriteria approach to evaluate inequality in education," The Journal of Economic Inequality, Springer;Society for the Study of Economic Inequality, vol. 18(4), pages 469-489, December.
    7. Giovanna Boccuzzo & Licia Maron, 2017. "Proposal of a composite indicator of job quality based on a measure of weighted distances," Quality & Quantity: International Journal of Methodology, Springer, vol. 51(5), pages 2357-2374, September.
    8. Greco, Salvatore & Ishizaka, Alessio & Tasiou, Menelaos & Torrisi, Gianpiero, 2018. "σ-µ efficiency analysis: A new methodology for evaluating units through composite indices," MPRA Paper 83569, University Library of Munich, Germany.
    9. Khatab Alqararah, 2023. "Assessing the robustness of composite indicators: the case of the Global Innovation Index," Journal of Innovation and Entrepreneurship, Springer, vol. 12(1), pages 1-22, December.
    10. Rachel M. Gisselquist, 2013. "Evaluating Governance Indexes: Critical and Less Critical Questions," WIDER Working Paper Series wp-2013-068, World Institute for Development Economic Research (UNU-WIDER).
    11. De Witte, Kristof & Schiltz, Fritz, 2018. "Measuring and explaining organizational effectiveness of school districts: Evidence from a robust and conditional Benefit-of-the-Doubt approach," European Journal of Operational Research, Elsevier, vol. 267(3), pages 1172-1181.
    12. Giuliano Resce & Fritz Schiltz, 2021. "Sustainable Development in Europe: A Multicriteria Decision Analysis," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 67(2), pages 509-529, June.
    13. D’Inverno, Giovanna & De Witte, Kristof, 2020. "Service level provision in municipalities: A flexible directional distance composite indicator," European Journal of Operational Research, Elsevier, vol. 286(3), pages 1129-1141.
    14. Chao Shi & Kenneth C. Land, 2021. "The Data Envelopment Analysis and Equal Weights/Minimax Methods of Composite Social Indicator Construction: a Methodological Study of Data Sensitivity and Robustness," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 16(4), pages 1689-1716, August.
    15. Ramon Sala-Garrido & Manuel Mocholí-Arce & María Molinos-Senante, 2021. "Assessing the Quality of Service of Water Companies: a ‘Benefit of the Doubt’ Composite Indicator," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 155(1), pages 371-387, May.
    16. Mosnier, Claire & Boukhriss, Sanae & Minviel, Jean-Joseph, 2023. "Does pig production improves cattle farm sustainability in the French massif central? A hierarchical constrained directional benefit-of-the-doubt approach," Agricultural Systems, Elsevier, vol. 210(C).
    17. Michela Gnaldi & M. Giovanna Ranalli, 2016. "Measuring University Performance by Means of Composite Indicators: A Robustness Analysis of the Composite Measure Used for the Benchmark of Italian Universities," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 129(2), pages 659-675, November.
    18. Oliveira, Renata & Zanella, Andreia & Camanho, Ana S., 2019. "The assessment of corporate social responsibility: The construction of an industry ranking and identification of potential for improvement," European Journal of Operational Research, Elsevier, vol. 278(2), pages 498-513.
    19. Fusco, Elisa & Vidoli, Francesco & Rogge, Nicky, 2020. "Spatial directional robust Benefit of the Doubt approach in presence of undesirable output: An application to Italian waste sector," Omega, Elsevier, vol. 94(C).
    20. Enrico Ivaldi & Gian Marco Ugolini, 2015. "The Nautical Quality Index (NaQi): Methodology and Application to the Case of Italy," Review of Economics & Finance, Better Advances Press, Canada, vol. 5, pages 43-58, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:ejores:v:288:y:2021:i:2:p:584-597. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/eor .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.