IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v42y2013i9p1647-1656.html
   My bibliography  Save this article

Complex innovation policy systems: Towards an evaluation mix

Author

Listed:
  • Magro, Edurne
  • Wilson, James R.

Abstract

The mix of contemporary innovation policies impacting on a given territory are typically characterised by quite different underlying rationales and instruments. Complexity is further increased by multi-level considerations. Thus policies with different characteristics and from different administrative levels are continually interacting with one another in complex policy systems. These interactions significantly complicate the evaluation of individual policies, and raise a series of difficult questions around how their respective evaluation processes should interact to facilitate learning around the performance of policy systems. This paper contributes with a simplified definition of an innovation policy system as the conjuncture of policy mix and multi-level dimensions, from which a series of steps are proposed for arriving at an evaluation mix relevant for the specific characteristics of a given policy space. These ideas are explored with respect to the case of the Basque Country region of Spain and signal an agenda for further applied policy research.

Suggested Citation

  • Magro, Edurne & Wilson, James R., 2013. "Complex innovation policy systems: Towards an evaluation mix," Research Policy, Elsevier, vol. 42(9), pages 1647-1656.
  • Handle: RePEc:eee:respol:v:42:y:2013:i:9:p:1647-1656
    DOI: 10.1016/j.respol.2013.06.005
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733313001091
    Download Restriction: Full text for ScienceDirect subscribers only

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Knut Koschatzky & Henning Kroll, 2007. "Which Side of the Coin? The Regional Governance of Science and Innovation," Regional Studies, Taylor & Francis Journals, vol. 41(8), pages 1115-1127.
    2. Mari Jose Aranguren Querejeta & Cristina Iturrioz Landart & James R. Wilson (ed.), 2008. "Networks, Governance and Economic Development," Books, Edward Elgar Publishing, number 12737.
    3. Robert A. Mundell, 1962. "The Appropriate Use of Monetary and Fiscal Policy for Internal and External Stability," IMF Staff Papers, Palgrave Macmillan, vol. 9(1), pages 70-79, March.
    4. Kuhlmann, Stefan, 2001. "Future governance of innovation policy in Europe -- three scenarios," Research Policy, Elsevier, vol. 30(6), pages 953-976, June.
    5. Erik Arnold, 2004. "Evaluating research and innovation policy: a systems world needs systems evaluations," Research Evaluation, Oxford University Press, vol. 13(1), pages 3-17, April.
    6. Cristina Chaminade & Bengt-åke Lundvall & Jan Vang & K. J. Joseph, 2009. "Designing Innovation Policies for Development: Towards a Systemic Experimentation-based Approach," Chapters, in: Bengt-Åke Lundvall & K. J. Joseph & Cristina Chaminade & Jan Vang (ed.),Handbook of Innovation Systems and Developing Countries, chapter 13, Edward Elgar Publishing.
    7. Mikel Navarro, 2010. "Reflexiones sobre el sistema y las políticas de innovación del País Vasco," Working Papers 2010R04, Orkestra - Basque Institute of Competitiveness.
    8. Charles Edquist, 2011. "Design of innovation policy through diagnostic analysis: identification of systemic problems (or failures)," Industrial and Corporate Change, Oxford University Press, vol. 20(6), pages 1725-1753, December.
    9. Jakob Edler & Bernd Ebersberger & Vivien Lo, 2008. "Improving policy understanding by means of secondary analyses of policy evaluation," Research Evaluation, Oxford University Press, vol. 17(3), pages 175-186, September.
    10. Susana Borrás, 2011. "Policy learning and organizational capacities in innovation policies," Science and Public Policy, Oxford University Press, vol. 38(9), pages 725-734, November.
    11. Clarysse, Bart & Wright, Mike & Mustar, Philippe, 2009. "Behavioural additionality of R&D subsidies: A learning perspective," Research Policy, Elsevier, vol. 38(10), pages 1517-1533, December.
    12. Laranja, Manuel & Uyarra, Elvira & Flanagan, Kieron, 2008. "Policies for science, technology and innovation: Translating rationales into regional policies in a multi-level setting," Research Policy, Elsevier, vol. 37(5), pages 823-835, June.
    13. Flanagan, Kieron & Uyarra, Elvira & Laranja, Manuel, 2011. "Reconceptualising the 'policy mix' for innovation," Research Policy, Elsevier, vol. 40(5), pages 702-713, June.
    14. Todtling, Franz & Trippl, Michaela, 2005. "One size fits all?: Towards a differentiated regional innovation policy approach," Research Policy, Elsevier, vol. 34(8), pages 1203-1219, October.
    15. Kevin Morgan, 2004. "The exaggerated death of geography: learning, proximity and territorial innovation systems," Journal of Economic Geography, Oxford University Press, vol. 4(1), pages 3-21, January.
    16. Metcalfe, J S, 1995. "Technology Systems and Technology Policy in an Evolutionary Framework," Cambridge Journal of Economics, Oxford University Press, vol. 19(1), pages 25-46, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ben R. Martin, 2015. "R&D Policy Instruments: A Critical Review of What We Do & Don't Know," Working Papers wp476, Centre for Business Research, University of Cambridge.
    2. Ainhoa Arrona, 2017. "Can interpretive policy analysis contribute to a critical scholarship on regional innovation policy studies?," Working Papers 2017R01, Orkestra - Basque Institute of Competitiveness.
    3. Federico Munari & Einar Rasmussen & Laura Toschi & Elisa Villani, 2016. "Determinants of the university technology transfer policy-mix: a cross-national analysis of gap-funding instruments," The Journal of Technology Transfer, Springer, vol. 41(6), pages 1377-1405, December.
    4. Okamuro, Hiroyuki & Nishimura, Junichi, 2019. "Effects of multilevel policy mix of public R&D subsidies: Empirical evidence from Japanese local SMEs," CCES Discussion Paper Series 70, Center for Research on Contemporary Economic Systems, Graduate School of Economics, Hitotsubashi University.
    5. Hüsing, Bärbel & Stahlecker, Thomas, 2009. "The impact of regionalised RTDI policy measures in Germany: the Network RNA Technologies Berlin (RiNA) as an example," Working Papers "Firms and Region" R5/2009, Fraunhofer Institute for Systems and Innovation Research (ISI).
    6. Jakob Edler & Jan Fagerberg, 2017. "Innovation policy: what, why, and how," Oxford Review of Economic Policy, Oxford University Press, vol. 33(1), pages 2-23.
    7. Chaminade, Cristina & Intarakumnerd, Patarapong & Sapprasert, Koson, 2012. "Measuring systemic problems in National Innovation Systems. An application to Thailand," Research Policy, Elsevier, vol. 41(8), pages 1476-1488.
    8. Autant-Bernard, Corinne & Fadairo, Muriel & Massard, Nadine, 2013. "Knowledge diffusion and innovation policies within the European regions: Challenges based on recent empirical evidence," Research Policy, Elsevier, vol. 42(1), pages 196-210.
    9. Grashof, Nils, 2020. "Putting the watering can away Towards a targeted (problem-oriented) cluster policy framework," Papers in Innovation Studies 2020/4, Lund University, CIRCLE - Center for Innovation Research.
    10. Borrás, Susana & Laatsit, Mart, 2019. "Towards system oriented innovation policy evaluation? Evidence from EU28 member states," Research Policy, Elsevier, vol. 48(1), pages 312-321.
    11. Magro, Edurne & Wilson, James R., 2019. "Policy-mix evaluation: Governance challenges from new place-based innovation policies," Research Policy, Elsevier, vol. 48(10).
    12. Kincsö Izsak & Paresa Markianidou & Slavo Radošević, 2015. "Convergence of National Innovation Policy Mixes in Europe – Has It Gone Too Far? An Analysis of Research and Innovation Policy Measures in the Period 2004–12," Journal of Common Market Studies, Wiley Blackwell, vol. 53(4), pages 786-802, July.
    13. Bleda, Mercedes & del Río, Pablo, 2013. "The market failure and the systemic failure rationales in technological innovation systems," Research Policy, Elsevier, vol. 42(5), pages 1039-1052.
    14. Matthijs Janssen, 2016. "What bangs for your bucks? Assessing the design and impact of transformative policy," Innovation Studies Utrecht (ISU) working paper series 16-05, Utrecht University, Department of Innovation Studies, revised Dec 2016.
    15. Attila Havas, 2015. "The persistent high-tech myth in the EC policy circles - Implications for the EU10 countries," CERS-IE WORKING PAPERS 1517, Institute of Economics, Centre for Economic and Regional Studies.
    16. Claire Nauwelaers & Inger Midtkandal & Inmaculada Periañez Forte, 2014. "RIS3 Implementation and Policy Mixes. S3 Policy Brief Series n° 07/2014 – September 2014," JRC Working Papers JRC91917, Joint Research Centre (Seville site).
    17. Anna J. Wieczorek & Marko P. Hekkert & Ruud E.H.M. Smits, 2009. "Contemporary Innovation Policy and Instruments: Challenges and Implications," Innovation Studies Utrecht (ISU) working paper series 09-12, Utrecht University, Department of Innovation Studies, revised Jul 2009.
    18. Hiroyuki Okamuro & Junichi Nishimura, 2020. "What Shapes Local Innovation Policies? Empirical Evidence from Japanese Cities," Administrative Sciences, MDPI, Open Access Journal, vol. 10(1), pages 1-22, February.
    19. Havas, Attila, 2014. "Mit mér(j)ünk?. Az innováció értelmezései - szakpolitikai következmények [The theory and measurement of innovation and its mutual effect on policy]," Közgazdasági Szemle (Economic Review - monthly of the Hungarian Academy of Sciences), Közgazdasági Szemle Alapítvány (Economic Review Foundation), vol. 0(9), pages 1022-1059.
    20. Janssen, Matthijs J., 2019. "What bangs for your buck? Assessing the design and impact of Dutch transformative policy," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 78-94.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:42:y:2013:i:9:p:1647-1656. See general information about how to correct material in RePEc.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: (Haili He). General contact details of provider: http://www.elsevier.com/locate/respol .

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service hosted by the Research Division of the Federal Reserve Bank of St. Louis . RePEc uses bibliographic data supplied by the respective publishers.