IDEAS home Printed from https://ideas.repec.org/a/oup/scippl/v50y2023i2p336-349..html
   My bibliography  Save this article

Mission incomplete: Layered practices of monitoring and evaluation in Swedish transformative innovation policy

Author

Listed:
  • Harald Rohracher
  • Lars Coenen
  • Olga Kordas

Abstract

Research and innovation policies (IPs) across Europe, particularly in Sweden, are increasingly framed by an orientation towards societal challenges, missions, and transformative change. Innovation-funding agencies are adapting to these new approaches but struggle with a host of new questions and challenges on how to re-structure public policy interventions and develop new structures for monitoring, learning, and evaluation. In this article, we investigate how this IP paradigm shift is dealt with in the IP discourse and practice in Sweden and how an incomplete shift creates mismatches and tensions with existing structures for programme evaluation and monitoring. Despite the new paradigm, the implementation of evaluation strategies mostly follows a traditional ‘summative’ framing. The ongoing discussions in Swedish IP demonstrate that a paradigm shift towards transformative innovation cannot unfold its potential unless it is also followed by a shift in the practices of programme implementation and evaluation.

Suggested Citation

  • Harald Rohracher & Lars Coenen & Olga Kordas, 2023. "Mission incomplete: Layered practices of monitoring and evaluation in Swedish transformative innovation policy," Science and Public Policy, Oxford University Press, vol. 50(2), pages 336-349.
    • Handle: RePEc:oup:scippl:v:50:y:2023:i:2:p:336-349.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/scipol/scac071
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mariana Mazzucato, 2018. "Mission-oriented innovation policies: challenges and opportunities," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(5), pages 803-815.
    2. Weber, K. Matthias & Rohracher, Harald, 2012. "Legitimizing research, technology and innovation policies for transformative change," Research Policy, Elsevier, vol. 41(6), pages 1037-1047.
    3. Ross Brown, 2021. "Mission-oriented or mission adrift? A critical examination of mission-oriented innovation policies," European Planning Studies, Taylor & Francis Journals, vol. 29(4), pages 739-761, April.
    4. Elvira Uyarra & Barbara Ribeiro & Lisa Dale-Clough, 2019. "Exploring the normative turn in regional innovation policy: responsibility and the quest for public value," European Planning Studies, Taylor & Francis Journals, vol. 27(12), pages 2359-2375, December.
    5. Jordi Molas-Gallart & Alejandra Boni & Sandro Giachi & Johan Schot, 2021. "A formative approach to the evaluation of Transformative Innovation Policies [The Need for Reflexive Evaluation Approaches in Development Cooperation]," Research Evaluation, Oxford University Press, vol. 30(4), pages 431-442.
    6. Kivimaa, Paula & Kern, Florian, 2016. "Creative destruction or mere niche support? Innovation policy mixes for sustainability transitions," Research Policy, Elsevier, vol. 45(1), pages 205-217.
    7. Geels, Frank W., 2022. "Causality and explanation in socio-technical transitions research: Mobilising epistemological insights from the wider social sciences," Research Policy, Elsevier, vol. 51(6).
    8. Florian Wittmann & Miriam Hufnagl & Ralf Lindner & Florian Roth & Jakob Edler, 2021. "Governing varieties of mission-oriented innovation policies: A new typology," Science and Public Policy, Oxford University Press, vol. 48(5), pages 727-738.
    9. Koen P.R. Bartels & Davydd J. Greenwood & Julia M. Wittmayer, 2020. "How action research can make deliberative policy analysis more transformative," Policy Studies, Taylor & Francis Journals, vol. 41(4), pages 392-410, July.
    10. Reetta Muhonen & Paul Benneworth & Julia Olmos-Peñuela, 2020. "From productive interactions to impact pathways: Understanding the key dimensions in developing SSH research societal impact," Research Evaluation, Oxford University Press, vol. 29(1), pages 34-47.
    11. Matthijs J. Janssen & Jonas Torrens & Joeri H. Wesseling & Iris Wanzenböck, 2021. "The promises and premises of mission-oriented innovation policy—A reflection and ways forward," Science and Public Policy, Oxford University Press, vol. 48(3), pages 438-444.
    12. Henning Kroll, 2019. "How to evaluate innovation strategies with a transformative ambition? A proposal for a structured, process-based approach," Science and Public Policy, Oxford University Press, vol. 46(5), pages 635-647.
    13. Mari Jose Aranguren & Edurne Magro & James R Wilson, 2017. "Regional competitiveness policy evaluation as a transformative process: From theory to practice," Environment and Planning C, , vol. 35(4), pages 703-720, June.
    14. Reale, Filippo, 2021. "Mission-oriented innovation policy and the challenge of urgency: Lessons from Covid-19 and beyond," Technovation, Elsevier, vol. 107(C).
    15. Matthijs J Janssen & Anna Bergek & Joeri H Wesseling, 2022. "Evaluating systemic innovation and transition programmes: Towards a culture of learning," PLOS Sustainability and Transformation, Public Library of Science, vol. 1(3), pages 1-6, March.
    16. Svensson, Oscar & Nikoleris, Alexandra, 2018. "Structure reconsidered: Towards new foundations of explanatory transitions theory," Research Policy, Elsevier, vol. 47(2), pages 462-473.
    17. Diercks, Gijs & Larsen, Henrik & Steward, Fred, 2019. "Transformative innovation policy: Addressing variety in an emerging policy paradigm," Research Policy, Elsevier, vol. 48(4), pages 880-894.
    18. Kieron Flanagan & Elvira Uyarra, 2016. "Four dangers in innovation policy studies -- and how to avoid them," Industry and Innovation, Taylor & Francis Journals, vol. 23(2), pages 177-188, February.
    19. Rainer Kattel & Mariana Mazzucato, 2018. "Mission-oriented innovation policy and dynamic capabilities in the public sector," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 27(5), pages 787-801.
    20. Grillitsch, Markus & Hansen, Teis & Coenen, Lars & Miörner, Johan & Moodysson, Jerker, 2019. "Innovation policy for system-wide transformation: The case of strategic innovation programmes (SIPs) in Sweden," Research Policy, Elsevier, vol. 48(4), pages 1048-1061.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Haddad, Carolina R. & Bergek, Anna, 2023. "Towards an integrated framework for evaluating transformative innovation policy," Research Policy, Elsevier, vol. 52(2).
    2. Matthijs J Janssen & Joeri Wesseling & Jonas Torrens & K Matthias & Caetano Penna & Laurens Klerkx, 2023. "Missions as boundary objects for transformative change: understanding coordination across policy, research, and stakeholder communities," Science and Public Policy, Oxford University Press, vol. 50(3), pages 398-415.
    3. Wiarda, Martijn & Sobota, Vladimir C.M. & Janssen, Matthijs J. & van de Kaa, Geerten & Yaghmaei, Emad & Doorn, Neelke, 2023. "Public participation in mission-oriented innovation projects," Technological Forecasting and Social Change, Elsevier, vol. 191(C).
    4. Matthijs Jansen, 2022. "Legitimation and Effects of Mission-Oriented Innovation Policies: A Spillover Perspective," Hacienda Pública Española / Review of Public Economics, IEF, vol. 243(4), pages 7-28, December.
    5. Janssen, Matthijs & Wanzenböck, Iris & Fünfschilling, Lea & Pontinakis, Dimitris, 2023. "Governance arrangements for the implementation of transformative innovation policy: Insights from a comparative case study," Papers in Innovation Studies 2023/13, Lund University, CIRCLE - Centre for Innovation Research.
    6. Santos, Anabela M. & Coad, Alex, 2023. "Monitoring and evaluation of transformative innovation policy: Suggestions for Improvement," Socio-Economic Planning Sciences, Elsevier, vol. 90(C).
    7. Uyarra, Elvira & Zabala-Iturriagagoitia, Jon Mikel & Flanagan, Kieron & Magro, Edurne, 2020. "Public procurement, innovation and industrial policy: Rationales, roles, capabilities and implementation," Research Policy, Elsevier, vol. 49(1).
    8. Edler, Jakob, 2023. "Demand, public procurement and transformation," Discussion Papers "Innovation Systems and Policy Analysis" 79, Fraunhofer Institute for Systems and Innovation Research (ISI).
    9. Maria Rabadjieva & Judith Terstriep, 2020. "Ambition Meets Reality: Mission-Oriented Innovation Policy as a Driver for Participative Governance," Sustainability, MDPI, vol. 13(1), pages 1-23, December.
    10. Roth, Florian & Wittmann, Florian & Hufnagl, Miriam & Lindner, Ralf, 2022. "Putting mission-oriented innovation policies to work: A case study of the German high-tech strategy 2025," Discussion Papers "Innovation Systems and Policy Analysis" 75, Fraunhofer Institute for Systems and Innovation Research (ISI).
    11. Jan Fagerberg & Håkon Endresen Normann, 2022. "Innovation policy, regulation and the transition to net zero," Working Papers on Innovation Studies 20220531, Centre for Technology, Innovation and Culture, University of Oslo.
    12. Verónica Robert & Gabriel Yoguel, 2022. "Exploration of trending concepts in innovation policy," Review of Evolutionary Political Economy, Springer, vol. 3(2), pages 259-292, July.
    13. Janssen, Matthijs J. & Abbasiharofteh, Milad, 2022. "Boundary spanning R&D collaboration: Key enabling technologies and missions as alleviators of proximity effects?," Technological Forecasting and Social Change, Elsevier, vol. 180(C).
    14. Paula Kivimaa & Karoline S. Rogge, 2020. "Interplay of Policy Experimentation and Institutional Change in Transformative Policy Mixes: The Case of Mobility as a Service in Finland," SPRU Working Paper Series 2020-17, SPRU - Science Policy Research Unit, University of Sussex Business School.
    15. Janssen, Matthijs J. & Abbasiharofteh, Milad, 2022. "Boundary spanning R&D collaboration: Key enabling technologies and missions as alleviators of proximity effects?," EconStor Open Access Articles and Book Chapters, ZBW - Leibniz Information Centre for Economics, vol. 180.
    16. Grillitsch, Markus & Hansen, Teis & Madsen, Stine, 2020. "How novel is Transformative Innovation Policy?," Papers in Innovation Studies 2020/8, Lund University, CIRCLE - Centre for Innovation Research.
    17. Erkki-Jussi Nylén & Jan-Erik Johanson & Jarmo Vakkuri, 2023. "Mission-oriented innovation policy as a hybridisation process: the case of transforming a national fertilising system," Science and Public Policy, Oxford University Press, vol. 50(3), pages 509-520.
    18. Francesco Cappellano & Francesco Molica & Teemu Makkonen, 2024. "Missions and Cohesion Policy: is there a match?," Science and Public Policy, Oxford University Press, vol. 51(3), pages 360-374.
    19. Edler, Jakob & Köhler, Jonathan Hugh & Wydra, Sven & Salas-Gironés, Edgar & Schiller, Katharina & Braun, Annette, 2021. "Dimensions of systems and transformations: Towards an integrated framework for system transformations," Working Papers "Sustainability and Innovation" S03/2021, Fraunhofer Institute for Systems and Innovation Research (ISI).
    20. Odeh Al-Jayyousi & Hira Amin & Hiba Ali Al-Saudi & Amjaad Aljassas & Evren Tok, 2023. "Mission-Oriented Innovation Policy for Sustainable Development: A Systematic Literature Review," Sustainability, MDPI, vol. 15(17), pages 1-21, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:scippl:v:50:y:2023:i:2:p:336-349.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/spp .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.