IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v13y2021i13p7395-d586997.html
   My bibliography  Save this article

Assessing Impact, Performance and Sustainability Potential of Smart City Projects: Towards a Case Agnostic Evaluation Framework

Author

Listed:
  • Konstantinos Kourtzanidis

    (Centre for Research and Technology Hellas (CERTH), Chemical Process and Energy Resources Institute (CPERI), Thermi, GR-57001 Thessaloniki, Greece)

  • Komninos Angelakoglou

    (Centre for Research and Technology Hellas (CERTH), Chemical Process and Energy Resources Institute (CPERI), Thermi, GR-57001 Thessaloniki, Greece)

  • Vasilis Apostolopoulos

    (Centre for Research and Technology Hellas (CERTH), Chemical Process and Energy Resources Institute (CPERI), Thermi, GR-57001 Thessaloniki, Greece)

  • Paraskevi Giourka

    (Centre for Research and Technology Hellas (CERTH), Chemical Process and Energy Resources Institute (CPERI), Thermi, GR-57001 Thessaloniki, Greece)

  • Nikolaos Nikolopoulos

    (Centre for Research and Technology Hellas (CERTH), Chemical Process and Energy Resources Institute (CPERI), Thermi, GR-57001 Thessaloniki, Greece)

Abstract

We report on a novel evaluation framework to globally assess the footprint of smart cities and communities (SCC) projects, being also expandable to the case of smart grid related projects. The uniform smart city evaluation (USE) framework is constructed upon three complementary evaluation axes: the first one aims to weigh up the success of a SCC project based on performance metrics against pre-defined project-specific target values. The second axis focuses on the project’s impact towards the sustainability of a city and it is bench-marked against national and international key objectives arising from strategic plans. This bench-marking feeds the third axis which provides a more inclusive evaluation against four pre-defined and widely acclaimed sectors of interest. The steps to be followed for the uniform evaluation of each axis and corresponding index are presented in detail, including necessary key performance indicator (KPI) normalization, weighting, and aggregation methods. The resulting indices’ scores for each axis (namely project performance index, sustainability impact index, and sustainability performance index) can be post-processed with adequate data processing and visualization tools to extract important information on the extent to which the range of success of a SCC project contributes to the city sustainability progress. Illustrative examples from an on-going SCC project are provided to highlight the strengths of the approach. The proposed framework can be used to compare multiple projects within a city and sustainability and project performance in different cities, evaluate the interventions chosen per project against city needs, benchmark and design future projects (with, e.g., reverse engineering, projections), as well as evaluate various spatial and temporal scales.

Suggested Citation

  • Konstantinos Kourtzanidis & Komninos Angelakoglou & Vasilis Apostolopoulos & Paraskevi Giourka & Nikolaos Nikolopoulos, 2021. "Assessing Impact, Performance and Sustainability Potential of Smart City Projects: Towards a Case Agnostic Evaluation Framework," Sustainability, MDPI, vol. 13(13), pages 1-38, July.
    • Handle: RePEc:gam:jsusta:v:13:y:2021:i:13:p:7395-:d:586997
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/13/13/7395/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/13/13/7395/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kenneth A. Grant & Steven Chuang, 2012. "An aggregating approach to ranking cities for knowledge-based development," International Journal of Knowledge-Based Development, Inderscience Enterprises Ltd, vol. 3(1), pages 17-34.
    2. Marsal-Llacuna, Maria-Lluïsa & Colomer-Llinàs, Joan & Meléndez-Frigola, Joaquim, 2015. "Lessons in urban monitoring taken from sustainable and livable cities to better address the Smart Cities initiative," Technological Forecasting and Social Change, Elsevier, vol. 90(PB), pages 611-622.
    3. Andrew J. Collins & Craig A. Jordan & R. Michael Robinson & Caitlin Cornelius & Ross Gore, 2020. "Exploring good cycling cities using multivariate statistics," Environment Systems and Decisions, Springer, vol. 40(4), pages 526-543, December.
    4. Mendizabal, Maddalen & Heidrich, Oliver & Feliu, Efren & García-Blanco, Gemma & Mendizabal, Alaitz, 2018. "Stimulating urban transition and transformation to achieve sustainable and resilient cities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 94(C), pages 410-418.
    5. Boglarka BARSI, 2018. "Beyond indicators, new methods in Smart city assessment," Smart Cities and Regional Development (SCRD) Journal, Smart-EDU Hub, Faculty of Public Administration, National University of Political Studies & Public Administration, vol. 2(1), pages 87-99, March.
    6. Delia D’Agostino & Paolo Zangheri & Luca Castellazzi, 2017. "Towards Nearly Zero Energy Buildings in Europe: A Focus on Retrofit in Non-Residential Buildings," Energies, MDPI, vol. 10(1), pages 1-15, January.
    7. Giuseppe Munda & Michela Nardo, 2009. "Noncompensatory/nonlinear composite indicators for ranking countries: a defensible setting," Applied Economics, Taylor & Francis Journals, vol. 41(12), pages 1513-1523.
    8. André Luis Azevedo Guedes & Jeferson Carvalho Alvarenga & Maurício Dos Santos Sgarbi Goulart & Martius Vicente Rodriguez y Rodriguez & Carlos Alberto Pereira Soares, 2018. "Smart Cities: The Main Drivers for Increasing the Intelligence of Cities," Sustainability, MDPI, vol. 10(9), pages 1-19, August.
    9. Silvia Bossi & Christoph Gollner & Sarah Theierling, 2020. "Towards 100 Positive Energy Districts in Europe: Preliminary Data Analysis of 61 European Cases," Energies, MDPI, vol. 13(22), pages 1-13, November.
    10. Kaufmann, Daniel & Kraay, Aart & Zoido-Lobaton, Pablo, 1999. "Aggregating governance indicators," Policy Research Working Paper Series 2195, The World Bank.
    11. Global Platform for Sustainable Cities, 2018. "Urban Sustainability Framework," World Bank Publications - Reports 29364, The World Bank Group.
    12. Paola Clerici Maestosi & Maria Beatrice Andreucci & Paolo Civiero, 2021. "Sustainable Urban Areas for 2030 in a Post-COVID-19 Scenario: Focus on Innovative Research and Funding Frameworks to Boost Transition towards 100 Positive Energy Districts and 100 Climate-Neutral Citi," Energies, MDPI, vol. 14(1), pages 1-14, January.
    13. Rafael Molinaro & Mohammad K. Najjar & Ahmed W. A. Hammad & Assed Haddad & Elaine Vazquez, 2020. "Urban Development Index (UDI): A Comparison between the City of Rio de Janeiro and Four Other Global Cities," Sustainability, MDPI, vol. 12(3), pages 1-25, January.
    14. Javier Antolín & Cristina de Torre & Miguel Á. García-Fuentes & Ana Pérez & Isabel Tomé & María L. Mirantes & Elena Hoyos, 2020. "Development of an Evaluation Framework for Smartness and Sustainability in Cities," Sustainability, MDPI, vol. 12(12), pages 1-25, June.
    15. Guitouni, Adel & Martel, Jean-Marc, 1998. "Tentative guidelines to help choosing an appropriate MCDA method," European Journal of Operational Research, Elsevier, vol. 109(2), pages 501-521, September.
    16. Heleen Buldeo Rai & Tom van Lier & Dries Meers & Cathy Macharis, 2018. "An indicator approach to sustainable urban freight transport," Journal of Urbanism: International Research on Placemaking and Urban Sustainability, Taylor & Francis Journals, vol. 11(1), pages 81-102, January.
    17. Komninos Angelakoglou & Georgios Gaidajis, 2020. "A Conceptual Framework to Evaluate the Environmental Sustainability Performance of Mining Industrial Facilities," Sustainability, MDPI, vol. 12(5), pages 1-20, March.
    18. Geniaux, Ghislain & Bellon, Stephane & Deverre, Christian & Powell, Blaise, 2009. "Sustainable Development Indicator Frameworks and Initiatives," Reports 57937, Wageningen University, SEAMLESS: System for Environmental and Agricultural Modelling; Linking European Science and Society.
    19. Pollesch, N. & Dale, V.H., 2015. "Applications of aggregation theory to sustainability assessment," Ecological Economics, Elsevier, vol. 114(C), pages 117-127.
    20. Sally P. Caird & Stephen H. Hallett, 2019. "Towards evaluation design for smart city development," Journal of Urban Design, Taylor & Francis Journals, vol. 24(2), pages 188-209, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lazar D. Gitelman & Mikhail V. Kozhevnikov & Maksim K. Ditenberg, 2025. "Financial Sustainability of Energy Business Development: The Unregulated Activity Phenomenon," Sustainability, MDPI, vol. 17(2), pages 1-25, January.
    2. Irene Bertolami & Adriano Bisello & Marco Volpatti & Marta Carla Bottero, 2024. "Exploring Multiple Benefits of Urban and Energy Regeneration Projects: A Stakeholder-Centred Methodological Approach," Energies, MDPI, vol. 17(12), pages 1-22, June.
    3. Eleonora Desogus & Ettore Bompard & Daniele Grosso, 2024. "A Composite Index for Tracking the Evolution towards Energy Transition at Urban Scale: The Turin Case Study," Energies, MDPI, vol. 17(6), pages 1-20, March.
    4. Miguel Á. García-Fuentes & Javier Antolín & Cristina de Torre & Ana Pérez & Isabel Tomé & María L. Mirantes & Fátima López & Javier Martín & Jaime Gómez, 2021. "Evaluation of Results of City Sustainable Transformation Projects in the Fields of Mobility and Energy Efficiency with Real Application in a District in Valladolid (Spain)," Sustainability, MDPI, vol. 13(17), pages 1-22, August.
    5. Gemechis Guteta & Hailu Worku, 2024. "The role of industrial parks in managing sustainability challenges of urban transition: empirical analysis of the context in Adama and Hawassa Industrial Parks of Ethiopia," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 26(11), pages 27827-27853, November.
    6. Mariusz Czupich & Justyna Łapińska & Vojtěch Bartoš, 2022. "Environmental Sustainability Assessment of the European Union’s Capital Cities," IJERPH, MDPI, vol. 19(7), pages 1-18, April.
    7. Laurentiu Nicolae Pricope & Valentin Marian Antohi & Alina Meca & Angela Buboi (Danaila) & Costinela Fortea & Monica Laura Zlati, 2024. "The New European Development Scoreboard for SDG11 at the European Level," Sustainability, MDPI, vol. 16(17), pages 1-21, September.
    8. Raquel Soriano-Gonzalez & Elena Perez-Bernabeu & Yusef Ahsini & Patricia Carracedo & Andres Camacho & Angel A. Juan, 2023. "Analyzing Key Performance Indicators for Mobility Logistics in Smart and Sustainable Cities: A Case Study Centered on Barcelona," Logistics, MDPI, vol. 7(4), pages 1-20, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Cinelli, Marco & Kadziński, Miłosz & Miebs, Grzegorz & Gonzalez, Michael & Słowiński, Roman, 2022. "Recommending multiple criteria decision analysis methods with a new taxonomy-based decision support system," European Journal of Operational Research, Elsevier, vol. 302(2), pages 633-651.
    2. Tara Vanli, 2024. "Ranking of Global Smart Cities Using Dynamic Factor Analysis," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 171(2), pages 405-437, January.
    3. Paola Clerici Maestosi, 2021. "Smart Cities and Positive Energy Districts: Urban Perspectives in 2020," Energies, MDPI, vol. 14(9), pages 1-5, April.
    4. Cinelli, Marco & Kadziński, Miłosz & Gonzalez, Michael & Słowiński, Roman, 2020. "How to support the application of multiple criteria decision analysis? Let us start with a comprehensive taxonomy," Omega, Elsevier, vol. 96(C).
    5. Attardi, Raffaele & Cerreta, Maria & Sannicandro, Valentina & Torre, Carmelo Maria, 2018. "Non-compensatory composite indicators for the evaluation of urban planning policy: The Land-Use Policy Efficiency Index (LUPEI)," European Journal of Operational Research, Elsevier, vol. 264(2), pages 491-507.
    6. Zhang, L.P. & Zhou, P., 2018. "A non-compensatory composite indicator approach to assessing low-carbon performance," European Journal of Operational Research, Elsevier, vol. 270(1), pages 352-361.
    7. Fusco, Elisa, 2015. "Enhancing non-compensatory composite indicators: A directional proposal," European Journal of Operational Research, Elsevier, vol. 242(2), pages 620-630.
    8. Xu, Xiaozhan, 2004. "A note on the subjective and objective integrated approach to determine attribute weights," European Journal of Operational Research, Elsevier, vol. 156(2), pages 530-532, July.
    9. Ernestyna Szpakowska-Loranc, 2021. "Multi-Attribute Analysis of Contemporary Cultural Buildings in the Historic Urban Fabric as Sustainable Spaces—Krakow Case Study," Sustainability, MDPI, vol. 13(11), pages 1-25, May.
    10. Coady, David & Grosh, Margaret & Hoddinott, John F., 2002. "Targeting outcomes redux," FCND briefs 144, International Food Policy Research Institute (IFPRI).
    11. Claus Holm & Morten Balling & Thomas Poulsen, 2014. "Corporate governance ratings as a means to reduce asymmetric information," Cogent Economics & Finance, Taylor & Francis Journals, vol. 2(1), pages 1-16, December.
    12. Regine Gerike & Caroline Koszowski & Bettina Schröter & Ralph Buehler & Paul Schepers & Johannes Weber & Rico Wittwer & Peter Jones, 2021. "Built Environment Determinants of Pedestrian Activities and Their Consideration in Urban Street Design," Sustainability, MDPI, vol. 13(16), pages 1-21, August.
    13. Maria Vincenza Ciasullo & Orlando Troisi & Mara Grimaldi & Daniele Leone, 2020. "Multi-level governance for sustainable innovation in smart communities: an ecosystems approach," International Entrepreneurship and Management Journal, Springer, vol. 16(4), pages 1167-1195, December.
    14. Beck, Thorsten & Demirguc-Kunt, Asli & Levine, Ross, 2006. "Bank supervision and corruption in lending," Journal of Monetary Economics, Elsevier, vol. 53(8), pages 2131-2163, November.
    15. Zeeshan Noor Siddiqui, 2017. "Understanding the Linkage among Public Procurement (PP), Corruption, and Tax Morale (TM) Through Agency Theory (AT): A Review," Business & Economic Review, Institute of Management Sciences, Peshawar, Pakistan, vol. 9(3), pages 258-288, September.
    16. López-Ochoa, Luis M. & Las-Heras-Casas, Jesús & López-González, Luis M. & Olasolo-Alonso, Pablo, 2019. "Towards nearly zero-energy buildings in Mediterranean countries: Energy Performance of Buildings Directive evolution and the energy rehabilitation challenge in the Spanish residential sector," Energy, Elsevier, vol. 176(C), pages 335-352.
    17. Izquierdo, Alejandro & Micco, Alejandro & Panizza, Ugo & Chong, Alberto E., 2003. "Corporate Governance and Private Capital Flows to Latin America," IDB Publications (Working Papers) 1457, Inter-American Development Bank.
    18. Sabrina Auci & Laura Castellucci & Manuela Coromaldi, 2021. "How does public spending affect technical efficiency? Some evidence from 15 European countries," Bulletin of Economic Research, Wiley Blackwell, vol. 73(1), pages 108-130, January.
    19. Alan Mee & Madeleine Lyes & Philip Crowe, 2021. "Energy Urbanity and Active Citizen Participation," Energies, MDPI, vol. 14(20), pages 1-20, October.
    20. Kittisak Lohwanitchai & Daranee Jareemit, 2021. "Modeling Energy Efficiency Performance and Cost-Benefit Analysis Achieving Net-Zero Energy Building Design: Case Studies of Three Representative Offices in Thailand," Sustainability, MDPI, vol. 13(9), pages 1-24, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:13:y:2021:i:13:p:7395-:d:586997. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.