IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v42y2013i9p1647-1656.html
   My bibliography  Save this article

Complex innovation policy systems: Towards an evaluation mix

Author

Listed:
  • Magro, Edurne
  • Wilson, James R.

Abstract

The mix of contemporary innovation policies impacting on a given territory are typically characterised by quite different underlying rationales and instruments. Complexity is further increased by multi-level considerations. Thus policies with different characteristics and from different administrative levels are continually interacting with one another in complex policy systems. These interactions significantly complicate the evaluation of individual policies, and raise a series of difficult questions around how their respective evaluation processes should interact to facilitate learning around the performance of policy systems. This paper contributes with a simplified definition of an innovation policy system as the conjuncture of policy mix and multi-level dimensions, from which a series of steps are proposed for arriving at an evaluation mix relevant for the specific characteristics of a given policy space. These ideas are explored with respect to the case of the Basque Country region of Spain and signal an agenda for further applied policy research.

Suggested Citation

  • Magro, Edurne & Wilson, James R., 2013. "Complex innovation policy systems: Towards an evaluation mix," Research Policy, Elsevier, vol. 42(9), pages 1647-1656.
    • Handle: RePEc:eee:respol:v:42:y:2013:i:9:p:1647-1656
    DOI: 10.1016/j.respol.2013.06.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733313001091
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2013.06.005?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Knut Koschatzky & Henning Kroll, 2007. "Which Side of the Coin? The Regional Governance of Science and Innovation," Regional Studies, Taylor & Francis Journals, vol. 41(8), pages 1115-1127.
    2. Christos Pitelis & Roger Sugden & James R. Wilson (ed.), 2006. "Clusters and Globalisation," Books, Edward Elgar Publishing, number 3334.
    3. Borrás, Susana, 2009. "The Widening and Deepening of Innovation Policy: What Conditions Provide for Effective Governance?," Papers in Innovation Studies 2009/2, Lund University, CIRCLE - Centre for Innovation Research.
    4. Mari Jose Aranguren Querejeta & Cristina Iturrioz Landart & James R. Wilson (ed.), 2008. "Networks, Governance and Economic Development," Books, Edward Elgar Publishing, number 12737.
    5. Robert A. Mundell, 1962. "The Appropriate Use of Monetary and Fiscal Policy for Internal and External Stability," IMF Staff Papers, Palgrave Macmillan, vol. 9(1), pages 70-79, March.
    6. Kuhlmann, Stefan, 2001. "Future governance of innovation policy in Europe -- three scenarios," Research Policy, Elsevier, vol. 30(6), pages 953-976, June.
    7. Erik Arnold, 2004. "Evaluating research and innovation policy: a systems world needs systems evaluations," Research Evaluation, Oxford University Press, vol. 13(1), pages 3-17, April.
    8. Bengt-Åke Lundvall & K. J. Joseph & Cristina Chaminade & Jan Vang (ed.), 2009. "Handbook of Innovation Systems and Developing Countries," Books, Edward Elgar Publishing, number 12943.
    9. Susana Borrás & Dimitrios Tsagdis, 2008. "Cluster Policies in Europe," Books, Edward Elgar Publishing, number 4134.
    10. Cristina Chaminade & Bengt-åke Lundvall & Jan Vang & K. J. Joseph, 2009. "Designing Innovation Policies for Development: Towards a Systemic Experimentation-based Approach," Chapters, in: Bengt-Åke Lundvall & K. J. Joseph & Cristina Chaminade & Jan Vang (ed.), Handbook of Innovation Systems and Developing Countries, chapter 13, Edward Elgar Publishing.
    11. Claire Nauwelaers & Rene Wintjes (ed.), 2008. "Innovation Policy in Europe," Books, Edward Elgar Publishing, number 4131.
    12. Mikel Navarro, 2010. "Reflexiones sobre el sistema y las políticas de innovación del País Vasco," Working Papers 2010R04, Orkestra - Basque Institute of Competitiveness.
    13. Charles Edquist, 2011. "Design of innovation policy through diagnostic analysis: identification of systemic problems (or failures)," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 20(6), pages 1725-1753, December.
    14. Jakob Edler & Bernd Ebersberger & Vivien Lo, 2008. "Improving policy understanding by means of secondary analyses of policy evaluation," Research Evaluation, Oxford University Press, vol. 17(3), pages 175-186, September.
    15. Elvira Uyarra & Kieron Flanagan, 2010. "From Regional Systems of Innovation to Regions as Innovation Policy Spaces," Environment and Planning C, , vol. 28(4), pages 681-695, August.
    16. Susana Borrás, 2011. "Policy learning and organizational capacities in innovation policies," Science and Public Policy, Oxford University Press, vol. 38(9), pages 725-734, November.
    17. Clarysse, Bart & Wright, Mike & Mustar, Philippe, 2009. "Behavioural additionality of R&D subsidies: A learning perspective," Research Policy, Elsevier, vol. 38(10), pages 1517-1533, December.
    18. Mari Jos� Aranguren & Xabier de la Maza & Mario Davide Parrilli & Ferran Vendrell-Herrero & James R. Wilson, 2014. "Nested Methodological Approaches for Cluster Policy Evaluation: An Application to the Basque Country," Regional Studies, Taylor & Francis Journals, vol. 48(9), pages 1547-1562, September.
    19. Laranja, Manuel & Uyarra, Elvira & Flanagan, Kieron, 2008. "Policies for science, technology and innovation: Translating rationales into regional policies in a multi-level setting," Research Policy, Elsevier, vol. 37(5), pages 823-835, June.
    20. Flanagan, Kieron & Uyarra, Elvira & Laranja, Manuel, 2011. "Reconceptualising the 'policy mix' for innovation," Research Policy, Elsevier, vol. 40(5), pages 702-713, June.
    21. Todtling, Franz & Trippl, Michaela, 2005. "One size fits all?: Towards a differentiated regional innovation policy approach," Research Policy, Elsevier, vol. 34(8), pages 1203-1219, October.
    22. Kevin Morgan, 2004. "The exaggerated death of geography: learning, proximity and territorial innovation systems," Journal of Economic Geography, Oxford University Press, vol. 4(1), pages 3-21, January.
    23. Metcalfe, J S, 1995. "Technology Systems and Technology Policy in an Evolutionary Framework," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 19(1), pages 25-46, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Mari Jose Aranguren & Edurne Magro & James R Wilson, 2017. "Regional competitiveness policy evaluation as a transformative process: From theory to practice," Environment and Planning C, , vol. 35(4), pages 703-720, June.
    2. Ainhoa Arrona, 2017. "Can interpretive policy analysis contribute to a critical scholarship on regional innovation policy studies?," Working Papers 2017R01, Orkestra - Basque Institute of Competitiveness.
    3. Grashof, Nils, 2020. "Putting the watering can away Towards a targeted (problem-oriented) cluster policy framework," Papers in Innovation Studies 2020/4, Lund University, CIRCLE - Centre for Innovation Research.
    4. Magro, Edurne & Wilson, James R., 2019. "Policy-mix evaluation: Governance challenges from new place-based innovation policies," Research Policy, Elsevier, vol. 48(10).
    5. Anastasiia Konstantynova & James R. Wilson, 2014. "Comparing Cluster Policies: An Analytical Framework," Working Papers 2014R01, Orkestra - Basque Institute of Competitiveness.
    6. Isaksen, Arne & Nilsson, Magnus, 2011. "Linking scientific and practical knowledge in innovation systems," Papers in Innovation Studies 2011/12, Lund University, CIRCLE - Centre for Innovation Research.
    7. Arne Isaksen & Magnus Nilsson, 2013. "Combined Innovation Policy: Linking Scientific and Practical Knowledge in Innovation Systems," European Planning Studies, Taylor & Francis Journals, vol. 21(12), pages 1919-1936, December.
    8. Claire Nauwelaers & Inger Midtkandal & Inmaculada Periañez Forte, 2014. "RIS3 Implementation and Policy Mixes. S3 Policy Brief Series n° 07/2014 September 2014," JRC Research Reports JRC91917, Joint Research Centre.
    9. Federico Munari & Einar Rasmussen & Laura Toschi & Elisa Villani, 2016. "Determinants of the university technology transfer policy-mix: a cross-national analysis of gap-funding instruments," The Journal of Technology Transfer, Springer, vol. 41(6), pages 1377-1405, December.
    10. Flanagan, Kieron & Uyarra, Elvira & Laranja, Manuel, 2011. "Reconceptualising the 'policy mix' for innovation," Research Policy, Elsevier, vol. 40(5), pages 702-713, June.
    11. Jakob Edler & Jan Fagerberg, 2017. "Innovation policy: what, why, and how," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 33(1), pages 2-23.
    12. Borrás, Susana & Edquist, Charles, 2013. "The choice of innovation policy instruments," Technological Forecasting and Social Change, Elsevier, vol. 80(8), pages 1513-1522.
    13. Ricard Esparza-Masana, 2022. "Towards Smart Specialisation 2.0. Main Challenges When Updating Strategies," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(1), pages 635-655, March.
    14. Chaminade, Cristina & Intarakumnerd, Patarapong & Sapprasert, Koson, 2012. "Measuring systemic problems in National Innovation Systems. An application to Thailand," Research Policy, Elsevier, vol. 41(8), pages 1476-1488.
    15. Autant-Bernard, Corinne & Fadairo, Muriel & Massard, Nadine, 2013. "Knowledge diffusion and innovation policies within the European regions: Challenges based on recent empirical evidence," Research Policy, Elsevier, vol. 42(1), pages 196-210.
    16. Flanagan, Kieron & Uyarra, Elvira & Laranja, Manuel, 2010. "The ‘policy mix’ for innovation: rethinking innovation policy in a multi-level, multi-actor context," MPRA Paper 23567, University Library of Munich, Germany.
    17. Borrás, Susana & Laatsit, Mart, 2019. "Towards system oriented innovation policy evaluation? Evidence from EU28 member states," Research Policy, Elsevier, vol. 48(1), pages 312-321.
    18. Ben R. Martin, 2015. "R&D Policy Instruments: A Critical Review of What We Do & Don't Know," Working Papers wp476, Centre for Business Research, University of Cambridge.
    19. Mikel Navarro Arancegui & Juan José Gibaja Martíns & Susana Franco Rodríguez & Asier Murciego Alonso, 2012. "Territorial Benchmarking Methodology: The Need to Identify Reference Regions," Chapters, in: Philip Cooke & Mario Davide Parrilli & José Luis Curbelo (ed.), Innovation, Global Change and Territorial Resilience, chapter 4, Edward Elgar Publishing.
    20. Haddad, Carolina R. & Bergek, Anna, 2023. "Towards an integrated framework for evaluating transformative innovation policy," Research Policy, Elsevier, vol. 52(2).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:42:y:2013:i:9:p:1647-1656. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.