IDEAS home Printed from https://ideas.repec.org/a/sae/envirc/v35y2017i4p703-720.html
   My bibliography  Save this article

Regional competitiveness policy evaluation as a transformative process: From theory to practice

Author

Listed:
  • Mari Jose Aranguren
  • Edurne Magro
  • James R Wilson

Abstract

Regional competitiveness policy evaluation is at an interesting juncture. Increasing demand for evaluation is emerging at a time when policy complexity is highlighting the limits of existing techniques. Moreover, widespread use of the concept of policy learning in conceptual analysis is not matched by experimentation and reflection that can articulate what policy learning means in practice. This paper explores the transformative role that evaluation can play in policy learning, in theory, and in practice. It analyses experience with three different competitiveness policy evaluations in the same regional and institutional setting. It finds that explicit demand for evaluation, decisions around the appropriate mode of knowledge generation, the existence of dialogue spaces where relevant policy–stakeholders (including researchers) frequently meet, and the development of trust and cognitive proximity within these meeting places, are all critical factors if evaluation is to be transformative.

Suggested Citation

  • Mari Jose Aranguren & Edurne Magro & James R Wilson, 2017. "Regional competitiveness policy evaluation as a transformative process: From theory to practice," Environment and Planning C, , vol. 35(4), pages 703-720, June.
  • Handle: RePEc:sae:envirc:v:35:y:2017:i:4:p:703-720
    DOI: 10.1177/0263774X16662469
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/0263774X16662469
    Download Restriction: no

    File URL: https://libkey.io/10.1177/0263774X16662469?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Edurne Magro & Mikel Navarro & Jon Mikel Zabala-Iturriagagoitia, 2014. "Coordination-Mix: The Hidden Face of STI Policy," Review of Policy Research, Policy Studies Organization, vol. 31(5), pages 367-389, September.
    2. Luciana Lazzeretti & Ernesto Tavoletti, 2005. "Higher Education Excellence and Local Economic Development: The Case of the Entrepreneurial University of Twente," European Planning Studies, Taylor & Francis Journals, vol. 13(3), pages 475-493, April.
    3. Michael Wohlgemuth, 2002. "Evolutionary Approaches to Politics," Kyklos, Wiley Blackwell, vol. 55(2), pages 223-246, May.
    4. Abdullah Gök & Jakob Edler, 2012. "The use of behavioural additionality evaluation in innovation policy making," Research Evaluation, Oxford University Press, vol. 21(4), pages 306-318, September.
    5. Susana Borrás & Dimitrios Tsagdis, 2008. "Cluster Policies in Europe," Books, Edward Elgar Publishing, number 4134.
    6. Francis M. Bator, 1958. "The Anatomy of Market Failure," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 72(3), pages 351-379.
    7. Rodríguez-Pose, Andrés & Tijmstra, Sylvia, 2009. "On the emergence and significance of local economic development strategies," Research Department working papers 200, CAF Development Bank Of Latinamerica.
    8. Jean Tirole, 1988. "The Theory of Industrial Organization," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262200716, April.
    9. Magro, Edurne & Wilson, James R., 2013. "Complex innovation policy systems: Towards an evaluation mix," Research Policy, Elsevier, vol. 42(9), pages 1647-1656.
    10. Judy L. Baker, 2000. "Evaluating the Impact of Development Projects on Poverty : A Handbook for Practitioners," World Bank Publications - Books, The World Bank Group, number 13949.
    11. John Goddard & Louise Kempton & Paul Vallance, 2013. "Universities and Smart Specialisation: challenges, tensions and opportunities for the innovation strategies of european regions," EKONOMIAZ. Revista vasca de Economía, Gobierno Vasco / Eusko Jaurlaritza / Basque Government, vol. 83(02), pages 83-102.
    12. Jakob Edler & Bernd Ebersberger & Vivien Lo, 2008. "Improving policy understanding by means of secondary analyses of policy evaluation," Research Evaluation, Oxford University Press, vol. 17(3), pages 175-186, September.
    13. repec:bla:kyklos:v:55:y:2002:i:2:p:223-46 is not listed on IDEAS
    14. K. J. Arrow, 1971. "The Economic Implications of Learning by Doing," Palgrave Macmillan Books, in: F. H. Hahn (ed.), Readings in the Theory of Growth, chapter 11, pages 131-149, Palgrave Macmillan.
    15. Mari Jos� Aranguren & Xabier de la Maza & Mario Davide Parrilli & Ferran Vendrell-Herrero & James R. Wilson, 2014. "Nested Methodological Approaches for Cluster Policy Evaluation: An Application to the Basque Country," Regional Studies, Taylor & Francis Journals, vol. 48(9), pages 1547-1562, September.
    16. Anastasiia Konstantynova & James R. Wilson, 2014. "Comparing Cluster Policies: An Analytical Framework," Working Papers 2014R01, Orkestra - Basque Institute of Competitiveness.
    17. Bruce C. Greenwald & Joseph E. Stiglitz, 1986. "Externalities in Economies with Imperfect Information and Incomplete Markets," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 101(2), pages 229-264.
    18. Knut Koschatzky & Henning Kroll, 2007. "Which Side of the Coin? The Regional Governance of Science and Innovation," Regional Studies, Taylor & Francis Journals, vol. 41(8), pages 1115-1127.
    19. Christos Pitelis & Roger Sugden & James R. Wilson (ed.), 2006. "Clusters and Globalisation," Books, Edward Elgar Publishing, number 3334.
    20. Mark Drabenstott, 2008. "Universities, Innovation and Regional Development: A View from the United States," Higher Education Management and Policy, OECD Publishing, vol. 20(2), pages 1-13.
    21. Erik Arnold, 2004. "Evaluating research and innovation policy: a systems world needs systems evaluations," Research Evaluation, Oxford University Press, vol. 13(1), pages 3-17, April.
    22. Mytelka, Lynn K. & Smith, Keith, 2002. "Policy learning and innovation theory: an interactive and co-evolving process," Research Policy, Elsevier, vol. 31(8-9), pages 1467-1479, December.
    23. Claire Nauwelaers & Rene Wintjes (ed.), 2008. "Innovation Policy in Europe," Books, Edward Elgar Publishing, number 4131.
    24. Susana Borrás, 2011. "Policy learning and organizational capacities in innovation policies," Science and Public Policy, Oxford University Press, vol. 38(9), pages 725-734, November.
    25. Laranja, Manuel & Uyarra, Elvira & Flanagan, Kieron, 2008. "Policies for science, technology and innovation: Translating rationales into regional policies in a multi-level setting," Research Policy, Elsevier, vol. 37(5), pages 823-835, June.
    26. Giuliani, Elisa & Pietrobelli, Carlo, 2014. "Social Network Analysis Methodologies for the Evaluation of Cluster Development Programs," Papers in Innovation Studies 2014/11, Lund University, CIRCLE - Centre for Innovation Research.
    27. Kevin Morgan, 1997. "The Learning Region: Institutions, Innovation and Regional Renewal," Regional Studies, Taylor & Francis Journals, vol. 31(5), pages 491-503.
    28. Metcalfe, J S, 1995. "Technology Systems and Technology Policy in an Evolutionary Framework," Cambridge Journal of Economics, Cambridge Political Economy Society, vol. 19(1), pages 25-46, February.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dimos Chatzinikolaou & Michail Demertzis & Charis Vlados, 2021. "European Entrepreneurship Reinforcement Policies in Macro, Meso, and Micro Terms for the Post-COVID-19 Era," Review of European Studies, Canadian Center of Science and Education, vol. 13(2), pages 1-39, June.
    2. César Melara-Gálvez & Emilio J. Morales-Fernández, 2022. "A Comparative Analysis of the Competitiveness of Central American Countries Based on the Global Competitiveness Index before the COVID-19 Pandemic," Sustainability, MDPI, vol. 14(14), pages 1-21, July.
    3. Correa, Paulo & Andres, Luis & Borja-Vega, Christian, 2013. "The impact of government support on firm R&D investments : a meta-analysis," Policy Research Working Paper Series 6532, The World Bank.
    4. Borrás, Susana & Laatsit, Mart, 2019. "Towards system oriented innovation policy evaluation? Evidence from EU28 member states," Research Policy, Elsevier, vol. 48(1), pages 312-321.
    5. Harald Rohracher & Lars Coenen & Olga Kordas, 2023. "Mission incomplete: Layered practices of monitoring and evaluation in Swedish transformative innovation policy," Science and Public Policy, Oxford University Press, vol. 50(2), pages 336-349.
    6. Magro, Edurne & Wilson, James R., 2019. "Policy-mix evaluation: Governance challenges from new place-based innovation policies," Research Policy, Elsevier, vol. 48(10).
    7. Ainhoa Arrona, 2017. "Can interpretive policy analysis contribute to a critical scholarship on regional innovation policy studies?," Working Papers 2017R01, Orkestra - Basque Institute of Competitiveness.
    8. Madeline Smith & James R. Wilson & Emily Wise, 2020. "Evaluating clusters: Where theory collides with practice," Regional Science Policy & Practice, Wiley Blackwell, vol. 12(3), pages 413-430, June.
    9. John Shutt & Joyce Liddle, 2020. "Comparing the development of Local Industrial Strategies across the Northern Powerhouse: Key emerging issues," Local Economy, London South Bank University, vol. 35(4), pages 297-315, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Magro, Edurne & Wilson, James R., 2013. "Complex innovation policy systems: Towards an evaluation mix," Research Policy, Elsevier, vol. 42(9), pages 1647-1656.
    2. Elvira Uyarra & Kieron Flanagan & Edurne Magro & James R Wilson & Markku Sotarauta, 2017. "Understanding regional innovation policy dynamics: Actors, agency and learning," Environment and Planning C, , vol. 35(4), pages 559-568, June.
    3. Claire Nauwelaers & Inger Midtkandal & Inmaculada Periañez Forte, 2014. "RIS3 Implementation and Policy Mixes. S3 Policy Brief Series n° 07/2014 September 2014," JRC Research Reports JRC91917, Joint Research Centre.
    4. James R. Wilson & Mari Jose Aranguren & Mikel Navarro, 2015. "From Plan to Process: Exploring the Leadership Implications of RIS3," Working Papers 2015R01, Orkestra - Basque Institute of Competitiveness.
    5. Elvira Uyarra, 2010. "What is evolutionary about ‘regional systems of innovation’? Implications for regional policy," Journal of Evolutionary Economics, Springer, vol. 20(1), pages 115-137, January.
    6. Anastasiia Konstantynova & James R. Wilson, 2014. "Comparing Cluster Policies: An Analytical Framework," Working Papers 2014R01, Orkestra - Basque Institute of Competitiveness.
    7. Jesús María Valdaliso, 2015. "Pertenencia a clústeres y comportamiento competitivo de las empresas: un estudio de seis asociaciones-clúster en el País Vasco," Working Papers 2015R02, Orkestra - Basque Institute of Competitiveness.
    8. Ricard Esparza-Masana, 2022. "Towards Smart Specialisation 2.0. Main Challenges When Updating Strategies," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 13(1), pages 635-655, March.
    9. Borrás, Susana & Laatsit, Mart, 2019. "Towards system oriented innovation policy evaluation? Evidence from EU28 member states," Research Policy, Elsevier, vol. 48(1), pages 312-321.
    10. Ainhoa Arrona, 2017. "Can interpretive policy analysis contribute to a critical scholarship on regional innovation policy studies?," Working Papers 2017R01, Orkestra - Basque Institute of Competitiveness.
    11. Mari José Aranguren & Miren Larrea & James R. Wilson, 2012. "Academia and Public Policy: Towards the Co-generation of Knowledge and Learning Processes," Palgrave Macmillan Books, in: Bjørn T. Asheim & Mario Davide Parrilli (ed.), Interactive Learning for Innovation, chapter 11, pages 275-289, Palgrave Macmillan.
    12. Esparza Masana, Ricard & Fernández, Tatiana, 2019. "Monitoring S3: Key dimensions and implications," Evaluation and Program Planning, Elsevier, vol. 77(C).
    13. Tea Petrin & Dragana Radicic, 2023. "Instrument policy mix and firm size: is there complementarity between R&D subsidies and R&D tax credits?," The Journal of Technology Transfer, Springer, vol. 48(1), pages 181-215, February.
    14. Antonioli,Davide & Marzucchi,Alberto & Montresor,Sandro, 2012. "Regional innovation policy and innovative behaviours. A propensity score matching evaluation," INGENIO (CSIC-UPV) Working Paper Series 201205, INGENIO (CSIC-UPV).
    15. Barbero, Javier & Zabala-Iturriagagoitia, Jon Mikel & Zofío, José L., 2021. "Is more always better? On the relevance of decreasing returns to scale on innovation," Technovation, Elsevier, vol. 107(C).
    16. Wise, Emily & Arnold, Erik, 2022. "Evaluating Transformation – what can we learn from the literature?," Papers in Innovation Studies 2022/10, Lund University, CIRCLE - Centre for Innovation Research.
    17. Grashof, Nils, 2020. "Putting the watering can away Towards a targeted (problem-oriented) cluster policy framework," Papers in Innovation Studies 2020/4, Lund University, CIRCLE - Centre for Innovation Research.
    18. Magro, Edurne & Wilson, James R., 2019. "Policy-mix evaluation: Governance challenges from new place-based innovation policies," Research Policy, Elsevier, vol. 48(10).
    19. Haddad, Carolina R. & Bergek, Anna, 2023. "Towards an integrated framework for evaluating transformative innovation policy," Research Policy, Elsevier, vol. 52(2).
    20. Howoldt, David, 2024. "Characterising innovation policy mixes in innovation systems," Research Policy, Elsevier, vol. 53(2).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:envirc:v:35:y:2017:i:4:p:703-720. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.