IDEAS home Printed from https://ideas.repec.org/a/eee/techno/v106y2021ics0166497221000924.html

Are living labs effective? Exploring the evidence

Author

Listed:
  • Paskaleva, Krassimira
  • Cooper, Ian

Abstract

The main question addressed in this article is whether the evidence that is publicly available validates the claim that Living Labs are an effective means for promoting innovation. Owing to widespread promotion of their usefulness as a practical tool for pursuing innovation, Living Labs have enjoyed increasing attention from researchers, policy-makers and practitioners. But despite the booming interest in Living Labs – where innovation is generally perceived as taking place in real-life environments – their actual performance remains under-researched. It has yet to be demonstrated whether, in practice, Living Labs speed up the design of ‘solutions’ to societal challenges or the sharing of user value. This study aims to assess the existing evidence about whether they really deliver. A broadly based literature review was conducted to discover whether those initiating Living Labs report success – achieving the objectives/benefits they set themselves. Conclusions are drawn about whether the evidence is, at present, strong enough to warrant the promotion this approach receives. We suggest that, despite their 20-year history, the operationalisation of and outcomes from Living Labs are still poorly understood owing to paucity of published evidence, compounded by inadequate research design and insufficient attention to implementing and reporting performance evaluations.

Suggested Citation

  • Paskaleva, Krassimira & Cooper, Ian, 2021. "Are living labs effective? Exploring the evidence," Technovation, Elsevier, vol. 106(C).
  • Handle: RePEc:eee:techno:v:106:y:2021:i:c:s0166497221000924
    DOI: 10.1016/j.technovation.2021.102311
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0166497221000924
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.technovation.2021.102311?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Paskaleva, Krassimira & Cooper, Ian, 2018. "Open innovation and the evaluation of internet-enabled public services in smart cities," Technovation, Elsevier, vol. 78(C), pages 4-14.
    2. Seppo Leminen & Mika Westerlund, 2012. "Towards innovation in Living Labs networks," International Journal of Product Development, Inderscience Enterprises Ltd, vol. 17(1/2), pages 43-59.
    3. Krassimira Paskaleva & Ian Cooper & Per Linde & Bo Peterson & Christina Götz, 2015. "Stakeholder Engagement in the Smart City: Making Living Labs Work," Public Administration and Information Technology, in: Manuel Pedro Rodríguez-Bolívar (ed.), Transforming City Governments for Successful Smart Cities, edition 127, pages 115-145, Springer.
    4. Mónica E. Edwards-Schachter & Cristian E. Matti & Enrique Alcántara, 2012. "Fostering Quality of Life through Social Innovation: A Living Lab Methodology Study Case," Review of Policy Research, Policy Studies Organization, vol. 29(6), pages 672-692, November.
    5. Lomas, K.J. & Oliveira, S. & Warren, P. & Haines, V.J. & Chatterton, T. & Beizaee, A. & Prestwood, E. & Gething, B., 2018. "Do domestic heating controls save energy? A review of the evidence," Renewable and Sustainable Energy Reviews, Elsevier, vol. 93(C), pages 52-75.
    6. Eric von Hippel, 2006. "Democratizing Innovation," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262720477, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mora, Luca & Gerli, Paolo & Ardito, Lorenzo & Messeni Petruzzelli, Antonio, 2023. "Smart city governance from an innovation management perspective: Theoretical framing, review of current practices, and future research agenda," Technovation, Elsevier, vol. 123(C).
    2. Elias Blanckaert & Louise Hallström & Iris Jennes & Wendy Van den Broeck, 2025. "What Could Possibly Go Wrong? Exploring Challenges and Mitigation Strategies of Applying a Living Lab Approach in an Innovation Project," Sustainability, MDPI, vol. 17(12), pages 1-20, June.
    3. Grahame Smith & Chloe Dixon & Rafaela Neiva Ganga & Daz Greenop, 2022. "How Do We Know Co-Created Solutions Work Effectively within the Real World of People Living with Dementia? Learning Methodological Lessons from a Co-Creation-to-Evaluation Case Study," IJERPH, MDPI, vol. 19(21), pages 1-9, November.
    4. Osorio, Ferney & Giones, Ferran & Dupont, Laurent & Camargo, Mauricio, 2025. "Innovation labs strategy: unfolding the multifaceted role of strategic intent," Technovation, Elsevier, vol. 141(C).
    5. Molinari, Marco & Anund Vogel, Jonas & Rolando, Davide & Lundqvist, Per, 2023. "Using living labs to tackle innovation bottlenecks: the KTH Live-In Lab case study," Applied Energy, Elsevier, vol. 338(C).
    6. Marina Van Geenhuizen, 2023. "Knowledge Advancing Shopping Mall Living Labs and Customer Value Co-Creation, with a Focus on Social Integration," Sustainability, MDPI, vol. 15(22), pages 1-14, November.
    7. Abi Saad, Elie & Agogué, Marine, 2024. "Living Labs in science-industry collaborations: Roles, design, and application patterns," Technovation, Elsevier, vol. 135(C).
    8. Chengbin Wang & Shibo Fu & Min Wang & Shiwei Xin, 2026. "On the construction of the entrepreneurship incubation mechanisms of entrepreneurial support organizations (ESOs) from the perspective of uncertainty," International Entrepreneurship and Management Journal, Springer, vol. 22(1), pages 1-26, March.
    9. Claudia Stuckrath & Maryse M. H. Chappin & Ernst Worrell, 2025. "What Drives Successful Campus Living Labs? The Case of Utrecht University," Sustainability, MDPI, vol. 17(12), pages 1-29, June.
    10. de Jong, Jeroen P.J. & Rigtering, Coen & Spaans, Lara, 2023. "Heroes of diffusion: Making user innovations widely available," Research Policy, Elsevier, vol. 52(8).
    11. Franzò, Simone & Doppio, Nicola & Natalicchio, Angelo & Frattini, Federico & Mion, Luca, 2023. "Designing innovation contests to support external knowledge search in small and medium-sized enterprises," Technovation, Elsevier, vol. 121(C).
    12. Alba Arias & Claudia Pennese & Olatz Grijalba & Yousra Sidqi, 2025. "Application of Living Lab Concept: Where, How and for What Is Being Used in Europe to Support Energy, Social and Environmental Transition," Sustainability, MDPI, vol. 17(6), pages 1-25, March.
    13. Sphokazi Phelokazi Mbatha & Josephine Kaviti Musango, 2022. "A Systematic Review on the Application of the Living Lab Concept and Role of Stakeholders in the Energy Sector," Sustainability, MDPI, vol. 14(21), pages 1-20, October.
    14. Ananya Tiwari & Luís Campos Rodrigues & Frances E. Lucy & Salem Gharbia, 2022. "Building Climate Resilience in Coastal City Living Labs Using Ecosystem-Based Adaptation: A Systematic Review," Sustainability, MDPI, vol. 14(17), pages 1-29, August.
    15. Christophe Favoreu & Christophe Maurel & Yoann Queyroi, 2025. "Influence of public innovation laboratories on the development of public sector ambidexterity [L'Influence des laboratoires d'innovation publique sur le développement de l'ambidextrie au sein du secteur public]," Post-Print hal-04495211, HAL.
    16. Abi Saad, Elie & Tremblay, Nathalie & Agogué, Marine, 2024. "A multi-level perspective on innovation intermediaries: The case of the diffusion of digital technologies in healthcare," Technovation, Elsevier, vol. 129(C).
    17. Oliver Weberg & Vaike Fors & Jesper Lund, 2025. "Scaling Deep with Local Community Champions in Living Labs," Sustainability, MDPI, vol. 17(13), pages 1-20, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerd Lupp & Aude Zingraff-Hamed & Josh J. Huang & Amy Oen & Stephan Pauleit, 2020. "Living Labs—A Concept for Co-Designing Nature-Based Solutions," Sustainability, MDPI, vol. 13(1), pages 1-22, December.
    2. Gabriella Esposito & Alberto Bertello & Luca Mora & David Tucek, 2026. "How do boundary objects influence people-centered smart cities? A systematic literature review," Review of Managerial Science, Springer, vol. 20(2), pages 617-648, February.
    3. Abi Saad, Elie & Agogué, Marine, 2024. "Living Labs in science-industry collaborations: Roles, design, and application patterns," Technovation, Elsevier, vol. 135(C).
    4. Katharina Greve & Riccardo De Vita & Seppo Leminen & Mika Westerlund, 2021. "Living Labs: From Niche to Mainstream Innovation Management," Sustainability, MDPI, vol. 13(2), pages 1-25, January.
    5. Adriano Tanda & Alberto De Marco, 2021. "A Review of an Urban Living Lab Initiative," Review of Policy Research, Policy Studies Organization, vol. 38(3), pages 370-390, May.
    6. Claude Paraponaris, 2017. "Plateformes numériques, conception ouverte et emploi," Post-Print halshs-01614430, HAL.
    7. Balashankar Mulloth, 2021. "Exploring Social Business Pathways: Green Map System as a Case in Point," RAC - Revista de Administração Contemporânea (Journal of Contemporary Administration), ANPAD - Associação Nacional de Pós-Graduação e Pesquisa em Administração, vol. 25(3), pages 190351-1903.
    8. Baxter, Jamie Scott & Chatzichristos, Georgios & Christmann, Gabriela & Hennebry, Barraí & Kovanen, Sunna & Novikova, Marina & Olmedo, Lucas & Stoustrup, Sune W. & van Twuijver, Mara & Umantseva, Anna, 2020. "Social Enterprises in Structurally Weak Rural Regions: Innovative Troubleshooters in Action. Handbook for Practitioners," IRS Dialog 6/2020, Leibniz Institute for Research on Society and Space (IRS).
    9. Jarle Hildrum & Dieter Ernst & Jan Fagerberg, 2011. "The Complex Interaction between Global Production Networks, Digital Information Systems and International Knowledge Transfers," Chapters, in: Cristiano Antonelli (ed.), Handbook on the Economic Complexity of Technological Change, chapter 16, Edward Elgar Publishing.
    10. Daniela Dobreva Pastarmadzhieva & Mina Nikolaeva Angelova & Stefan Atanasov Raychev & Blaga Petrova Madzhurova & Kiril Valkov Desev, 2022. "Ensuring Sustainability during a Crisis Using an Innovative Flexible Methodology," Sustainability, MDPI, vol. 14(5), pages 1-20, March.
    11. Roy, Abhijit & Chattopadhyay, Satya P., 2010. "Stealth marketing as a strategy," Business Horizons, Elsevier, vol. 53(1), pages 69-79, January.
    12. Schäuble, Dominik & Marian, Adela & Cremonese, Lorenzo, 2020. "Conditions for a cost-effective application of smart thermostat systems in residential buildings," Applied Energy, Elsevier, vol. 262(C).
    13. Scott Dexter & Aaron Kozbelt, 2013. "Free and open source software (FOSS) as a model domain for answering big questions about creativity," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 12(1), pages 113-123, June.
    14. Aksel Ersoy & Ellen van Bueren, 2020. "Challenges of Urban Living Labs towards the Future of Local Innovation," Urban Planning, Cogitatio Press, vol. 5(4), pages 89-100.
    15. Mingbo Ji & Mengyun Jin & Lingyun Chen & Yuwei Liu & Yihao Tian, 2024. "Promoting Urban Innovation through Smart Cities: Evidence from a Quasi-Natural Experiment in China," Land, MDPI, vol. 13(3), pages 1-18, March.
    16. Edwards-Schachter,Mónica & Wallace,Matthew, 2015. "âShaken, but not stirredâ: six decades defining social innovation," INGENIO (CSIC-UPV) Working Paper Series 201504, INGENIO (CSIC-UPV).
    17. Humberto Merritt, 2015. "The Role of Human Capital in University-Business Cooperation: The Case of Mexico," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 6(3), pages 568-588, September.
    18. M. Joseph Sirgy & Richard J. Estes & Don R. Rahtz, 2018. "Combatting Jihadist Terrorism: A Quality-of-Life Perspective," Applied Research in Quality of Life, Springer;International Society for Quality-of-Life Studies, vol. 13(4), pages 813-837, December.
    19. Carijn Beumer, 2017. "Sustopia or Cosmopolis? A Critical Reflection on the Sustainable City," Sustainability, MDPI, vol. 9(5), pages 1-14, May.
    20. Ghasemzadeh, Behnam & Rasoulzadeh Aghdam, Samad & Hartley, Kris & Bababeimorad, Behnaz & Rahnamayiezekavat, Payam, 2026. "Social challenges in smart cities: a scoping review and framework for policy action," Technology in Society, Elsevier, vol. 84(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:techno:v:106:y:2021:i:c:s0166497221000924. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.sciencedirect.com/science/journal/01664972 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.