IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v52y2023i2s0048733322001974.html
   My bibliography  Save this article

Towards an integrated framework for evaluating transformative innovation policy

Author

Listed:
  • Haddad, Carolina R.
  • Bergek, Anna

Abstract

In recent years, a new frame for innovation policy has emerged, namely “transformative innovation policy” (TIP), which aims at addressing transformative change or “Grand Challenges”. Such a shift in policy theory should, ideally, be reflected in policy evaluation, but the literature has so far provided little advice on how to address TIP-related evaluation challenges such as directionality and system-level behavioural additionality. This paper discusses how the evaluation of policy interventions targeting system innovation can be designed to address these challenges. Combining the literature on sustainability transitions with policy evaluation, we propose an integrated evaluation framework composed of three main components: (i) programme theory (programme goals, systems boundaries and desired (or accepted) development paths); (ii) system analysis (transformative outcomes); and (iii) synthesis and overall assessment (including revision of programme theory). By integrating the two sets of literature, we provide a bridge between academic research on transitions and current evaluation practices. We briefly illustrate the applicability of the integrated framework in the BioInnovation Strategic Innovation Programme in Sweden.

Suggested Citation

  • Haddad, Carolina R. & Bergek, Anna, 2023. "Towards an integrated framework for evaluating transformative innovation policy," Research Policy, Elsevier, vol. 52(2).
    • Handle: RePEc:eee:respol:v:52:y:2023:i:2:s0048733322001974
    DOI: 10.1016/j.respol.2022.104676
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733322001974
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2022.104676?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Weber, K. Matthias & Rohracher, Harald, 2012. "Legitimizing research, technology and innovation policies for transformative change," Research Policy, Elsevier, vol. 41(6), pages 1037-1047.
    2. Smith, Adrian & Raven, Rob, 2012. "What is protective space? Reconsidering niches in transitions to sustainability," Research Policy, Elsevier, vol. 41(6), pages 1025-1036.
    3. Gordon Akon-Yamga & Chux U. Daniels & Wilhemina Quaye & Blanche M. Ting & Adelaide A. Asante, 2021. "Transformative innovation policy approach to e-waste management in Ghana: Perspectives of actors on transformative changes," Science and Public Policy, Oxford University Press, vol. 48(3), pages 387-397.
    4. Roberts, Cameron & Geels, Frank W., 2019. "Conditions for politically accelerated transitions: Historical institutionalism, the multi-level perspective, and two historical case studies in transport and agriculture," Technological Forecasting and Social Change, Elsevier, vol. 140(C), pages 221-240.
    5. Edsand, Hans-Erik, 2017. "Identifying barriers to wind energy diffusion in Colombia: A function analysis of the technological innovation system and the wider context," Technology in Society, Elsevier, vol. 49(C), pages 1-15.
    6. Negro, Simona O. & Hekkert, Marko P. & Smits, Ruud E., 2007. "Explaining the failure of the Dutch innovation system for biomass digestion--A functional analysis," Energy Policy, Elsevier, vol. 35(2), pages 925-938, February.
    7. De Oliveira, Luiz Gustavo Silva & Negro, Simona O., 2019. "Contextual structures and interaction dynamics in the Brazilian Biogas Innovation System," Renewable and Sustainable Energy Reviews, Elsevier, vol. 107(C), pages 462-481.
    8. Fagerberg, Jan, 2018. "Mobilizing innovation for sustainability transitions: A comment on transformative innovation policy," Research Policy, Elsevier, vol. 47(9), pages 1568-1576.
    9. Bipashyee Ghosh & Paula Kivimaa & Matias Ramirez & Johan Schot & Jonas Torrens, 2021. "Transformative outcomes: assessing and reorienting experimentation with transformative innovation policy," Science and Public Policy, Oxford University Press, vol. 48(5), pages 739-756.
    10. Martin, Ben R., 2012. "The evolution of science policy and innovation studies," Research Policy, Elsevier, vol. 41(7), pages 1219-1239.
    11. Geels, Frank W. & Schot, Johan, 2007. "Typology of sociotechnical transition pathways," Research Policy, Elsevier, vol. 36(3), pages 399-417, April.
    12. Zolfagharian, Mohammadreza & Walrave, Bob & Raven, Rob & Romme, A. Georges L., 2019. "Studying transitions: Past, present, and future," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    13. Matthijs J. Janssen & Maya Bogers & Iris Wanzenböck, 2020. "Do systemic innovation intermediaries broaden horizons? A proximity perspective on R&D partnership formation," Industry and Innovation, Taylor & Francis Journals, vol. 27(6), pages 605-629, June.
    14. Laurent Bach & Mireille Matt, 2005. "From Economic Foundations to S&T Policy Tools: a Comparative Analysis of the Dominant Paradigms," Springer Books, in: Patrick Llerena & Mireille Matt (ed.), Innovation Policy in a Knowledge-Based Economy, chapter 1, pages 17-45, Springer.
    15. Magro, Edurne & Wilson, James R., 2019. "Policy-mix evaluation: Governance challenges from new place-based innovation policies," Research Policy, Elsevier, vol. 48(10).
    16. Robinson, Douglas K.R. & Schoen, Antoine & Larédo, Philippe & Gallart, Jordi Molas & Warnke, Philine & Kuhlmann, Stefan & Ordóñez-Matamoros, Gonzalo, 2021. "Policy lensing of future-oriented strategic intelligence: An experiment connecting foresight with decision making contexts," Technological Forecasting and Social Change, Elsevier, vol. 169(C).
    17. Magro, Edurne & Wilson, James R., 2013. "Complex innovation policy systems: Towards an evaluation mix," Research Policy, Elsevier, vol. 42(9), pages 1647-1656.
    18. Jakob Edler & Bernd Ebersberger & Vivien Lo, 2008. "Improving policy understanding by means of secondary analyses of policy evaluation," Research Evaluation, Oxford University Press, vol. 17(3), pages 175-186, September.
    19. Reed, M.S. & Ferré, M. & Martin-Ortega, J. & Blanche, R. & Lawford-Rolfe, R. & Dallimer, M. & Holden, J., 2021. "Evaluating impact from research: A methodological framework," Research Policy, Elsevier, vol. 50(4).
    20. Eugenia Perez Vico & Staffan Jacobsson, 2012. "Identifying, explaining and improving the effects of academic R&D: The case of nanotechnology in Sweden," Science and Public Policy, Oxford University Press, vol. 39(4), pages 513-529, May.
    21. Janssen, Matthijs J., 2019. "What bangs for your buck? Assessing the design and impact of Dutch transformative policy," Technological Forecasting and Social Change, Elsevier, vol. 138(C), pages 78-94.
    22. Jacobsson, Staffan & Johnson, Anna, 2000. "The diffusion of renewable energy technology: an analytical framework and key issues for research," Energy Policy, Elsevier, vol. 28(9), pages 625-640, July.
    23. Sharif, Naubahar, 2006. "Emergence and development of the National Innovation Systems concept," Research Policy, Elsevier, vol. 35(5), pages 745-766, June.
    24. Jordi Molas-Gallart & Alejandra Boni & Sandro Giachi & Johan Schot, 2021. "A formative approach to the evaluation of Transformative Innovation Policies [The Need for Reflexive Evaluation Approaches in Development Cooperation]," Research Evaluation, Oxford University Press, vol. 30(4), pages 431-442.
    25. Sorrell, Steve, 2018. "Explaining sociotechnical transitions: A critical realist perspective," Research Policy, Elsevier, vol. 47(7), pages 1267-1282.
    26. Anna Bergek & Staffan Jacobsson & Marko Hekkert & Keith Smith, 2010. "Functionality of Innovation Systems as a Rationale for and Guide to Innovation Policy," Chapters, in: Ruud E. Smits & Stefan Kuhlmann & Phillip Shapira (ed.), The Theory and Practice of Innovation Policy, chapter 6, Edward Elgar Publishing.
    27. Stefan Kuhlmann & Arie Rip, 2018. "Next-Generation Innovation Policy and Grand Challenges," Science and Public Policy, Oxford University Press, vol. 45(4), pages 448-454.
    28. Ross Brown & Geoff Gregson & Colin Mason, 2016. "A Post-Mortem of Regional Innovation Policy Failure: Scotland's Intermediate Technology Initiative (ITI)," Regional Studies, Taylor & Francis Journals, vol. 50(7), pages 1260-1272, July.
    29. Rogge, Karoline S. & Reichardt, Kristin, 2016. "Policy mixes for sustainability transitions: An extended concept and framework for analysis," Research Policy, Elsevier, vol. 45(8), pages 1620-1635.
    30. Geels, Frank W., 2002. "Technological transitions as evolutionary reconfiguration processes: a multi-level perspective and a case-study," Research Policy, Elsevier, vol. 31(8-9), pages 1257-1274, December.
    31. Raven, Rob & Walrave, Bob, 2020. "Overcoming transformational failures through policy mixes in the dynamics of technological innovation systems," Technological Forecasting and Social Change, Elsevier, vol. 153(C).
    32. Kivimaa, Paula & Kern, Florian, 2016. "Creative destruction or mere niche support? Innovation policy mixes for sustainability transitions," Research Policy, Elsevier, vol. 45(1), pages 205-217.
    33. Anna J. Wieczorek & Marko P. Hekkert, 2012. "Systemic instruments for systemic innovation problems: A framework for policy makers and innovation scholars," Science and Public Policy, Oxford University Press, vol. 39(1), pages 74-87, February.
    34. Susana Borrás & Sylvia Schwaag Serger, 2022. "The design of transformative research and innovation policy instruments for grand challenges: The policy-nesting perspective [Transformative Innovation Policy Approach to E-waste Management in Ghan," Science and Public Policy, Oxford University Press, vol. 49(5), pages 659-672.
    35. Geels, Frank W., 2022. "Causality and explanation in socio-technical transitions research: Mobilising epistemological insights from the wider social sciences," Research Policy, Elsevier, vol. 51(6).
    36. Anna Bergek, 2019. "Technological innovation systems: a review of recent findings and suggestions for future research," Chapters, in: Frank Boons & Andrew McMeekin (ed.), Handbook of Sustainable Innovation, chapter 11, pages 200-218, Edward Elgar Publishing.
    37. Pel, Bonno & Raven, Rob & van Est, Rinie, 2020. "Transitions governance with a sense of direction: synchronization challenges in the case of the dutch ‘Driverless Car’ transition," Technological Forecasting and Social Change, Elsevier, vol. 160(C).
    38. Tsouri, Maria & Hansen, Teis & Hanson, Jens & Steen, Markus, 2022. "Knowledge recombination for emerging technological innovations: The case of green shipping," Technovation, Elsevier, vol. 114(C).
    39. Edmondson, Duncan L. & Kern, Florian & Rogge, Karoline S., 2019. "The co-evolution of policy mixes and socio-technical systems: Towards a conceptual framework of policy mix feedback in sustainability transitions," Research Policy, Elsevier, vol. 48(10).
    40. Henning Kroll, 2019. "How to evaluate innovation strategies with a transformative ambition? A proposal for a structured, process-based approach," Science and Public Policy, Oxford University Press, vol. 46(5), pages 635-647.
    41. Naber, Rolf & Raven, Rob & Kouw, Matthijs & Dassen, Ton, 2017. "Scaling up sustainable energy innovations," Energy Policy, Elsevier, vol. 110(C), pages 342-354.
    42. Geels, Frank W. & Kern, Florian & Fuchs, Gerhard & Hinderer, Nele & Kungl, Gregor & Mylan, Josephine & Neukirch, Mario & Wassermann, Sandra, 2016. "The enactment of socio-technical transition pathways: A reformulated typology and a comparative multi-level analysis of the German and UK low-carbon electricity transitions (1990–2014)," Research Policy, Elsevier, vol. 45(4), pages 896-913.
    43. Anna J. Wieczorek & Marko P. Hekkert, 2012. "Corrigendum to 'Systemic instruments for systemic innovation problems: A framework for policy makers and innovation scholars'," Science and Public Policy, Oxford University Press, vol. 39(6), pages 842-842, December.
    44. Tulia G. Falleti, 2016. "Process tracing of extensive and intensive processes," New Political Economy, Taylor & Francis Journals, vol. 21(5), pages 455-462, September.
    45. Erik Arnold, 2004. "Evaluating research and innovation policy: a systems world needs systems evaluations," Research Evaluation, Oxford University Press, vol. 13(1), pages 3-17, April.
    46. Kanger, Laur & Sovacool, Benjamin K. & Noorkõiv, Martin, 2020. "Six policy intervention points for sustainability transitions: A conceptual framework and a systematic literature review," Research Policy, Elsevier, vol. 49(7).
    47. Hof, Andries F. & van Vuuren, Detlef P. & Berkhout, Frans & Geels, Frank W., 2020. "Understanding transition pathways by bridging modelling, transition and practice-based studies: Editorial introduction to the special issue," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    48. Geels, Frank W., 2004. "From sectoral systems of innovation to socio-technical systems: Insights about dynamics and change from sociology and institutional theory," Research Policy, Elsevier, vol. 33(6-7), pages 897-920, September.
    49. Markus M Bugge & Lars Coenen & Are Branstad, 2018. "Governing socio-technical change: Orchestrating demand for assisted living in ageing societies," Science and Public Policy, Oxford University Press, vol. 45(4), pages 468-479.
    50. Bergek, Anna & Jacobsson, Staffan & Carlsson, Bo & Lindmark, Sven & Rickne, Annika, 2008. "Analyzing the functional dynamics of technological innovation systems: A scheme of analysis," Research Policy, Elsevier, vol. 37(3), pages 407-429, April.
    51. Laurent Bach & Mireille Matt, 2005. "From Economic Foundations to S&T Policy Tools : A Comparative Analysis of the Dominant Paradigms," Post-Print hal-00279442, HAL.
    52. Matthijs J Janssen & Anna Bergek & Joeri H Wesseling, 2022. "Evaluating systemic innovation and transition programmes: Towards a culture of learning," PLOS Sustainability and Transformation, Public Library of Science, vol. 1(3), pages 1-6, March.
    53. Jan Fagerberg, 2017. "Innovation Policy: Rationales, Lessons And Challenges," Journal of Economic Surveys, Wiley Blackwell, vol. 31(2), pages 497-512, April.
    54. Markus Bugge & Lars Coenen & Pedro Marques & Kevin Morgan, 2017. "Governing system innovation: assisted living experiments in the UK and Norway," European Planning Studies, Taylor & Francis Journals, vol. 25(12), pages 2138-2156, December.
    55. Bugge, Markus M. & Fevolden, Arne Martin & Klitkou, Antje, 2019. "Governance for system optimization and system change: The case of urban waste," Research Policy, Elsevier, vol. 48(4), pages 1076-1090.
    56. Cristina Chaminade & Charles Esquist, 2010. "Rationales for Public Policy Intervention in the Innovation Process: Systems of Innovation Approach," Chapters, in: Ruud E. Smits & Stefan Kuhlmann & Phillip Shapira (ed.), The Theory and Practice of Innovation Policy, chapter 5, Edward Elgar Publishing.
    57. Kern, Florian, 2012. "Using the multi-level perspective on socio-technical transitions to assess innovation policy," Technological Forecasting and Social Change, Elsevier, vol. 79(2), pages 298-310.
    58. Bo Carlsson & Lennart Elg & Staffan Jacobsson, 2010. "Reflections on the Co-evolution of Innovation Theory, Policy and Practice: The Emergence of the Swedish Agency for Innovation Systems," Chapters, in: Ruud E. Smits & Stefan Kuhlmann & Phillip Shapira (ed.), The Theory and Practice of Innovation Policy, chapter 7, Edward Elgar Publishing.
    59. Michael P. Schlaile & Sophie Urmetzer & Vincent Blok & Allan Dahl Andersen & Job Timmermans & Matthias Mueller & Jan Fagerberg & Andreas Pyka, 2017. "Innovation Systems for Transformations towards Sustainability? Taking the Normative Dimension Seriously," Sustainability, MDPI, vol. 9(12), pages 1-20, December.
    60. Rametsteiner, Ewald & Weiss, Gerhard, 2006. "Assessing policies from a systems perspecitve -- Experiences with applied innovation systems analysis and implications for policy evaluation," Forest Policy and Economics, Elsevier, vol. 8(5), pages 564-576, July.
    61. Svensson, Oscar & Nikoleris, Alexandra, 2018. "Structure reconsidered: Towards new foundations of explanatory transitions theory," Research Policy, Elsevier, vol. 47(2), pages 462-473.
    62. Diercks, Gijs & Larsen, Henrik & Steward, Fred, 2019. "Transformative innovation policy: Addressing variety in an emerging policy paradigm," Research Policy, Elsevier, vol. 48(4), pages 880-894.
    63. Clarysse, Bart & Wright, Mike & Mustar, Philippe, 2009. "Behavioural additionality of R&D subsidies: A learning perspective," Research Policy, Elsevier, vol. 38(10), pages 1517-1533, December.
    64. Schot, Johan & Steinmueller, W. Edward, 2018. "Three frames for innovation policy: R&D, systems of innovation and transformative change," Research Policy, Elsevier, vol. 47(9), pages 1554-1567.
    65. Douglas K. R. Robinson & Antoine Schoen & Philippe Larédo & Jordi Molas Gallart & Philine Warnke & Stefan Kuhlmann & Gonzalo Ordóñez-Matamoros, 2021. "Policy lensing of future-oriented strategic intelligence: An experiment connecting foresight with decision making contexts," Post-Print hal-03232913, HAL.
    66. Todtling, Franz & Trippl, Michaela, 2005. "One size fits all?: Towards a differentiated regional innovation policy approach," Research Policy, Elsevier, vol. 34(8), pages 1203-1219, October.
    67. Fuenfschilling, Lea & Binz, Christian, 2018. "Global socio-technical regimes," Research Policy, Elsevier, vol. 47(4), pages 735-749.
    68. Rosenbloom, Daniel & Berton, Harris & Meadowcroft, James, 2016. "Framing the sun: A discursive approach to understanding multi-dimensional interactions within socio-technical transitions through the case of solar electricity in Ontario, Canada," Research Policy, Elsevier, vol. 45(6), pages 1275-1290.
    69. Grillitsch, Markus & Hansen, Teis & Coenen, Lars & Miörner, Johan & Moodysson, Jerker, 2019. "Innovation policy for system-wide transformation: The case of strategic innovation programmes (SIPs) in Sweden," Research Policy, Elsevier, vol. 48(4), pages 1048-1061.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maria Tomai & Shyama V. Ramani & George Papachristos, 2024. "How Can We Design Policy Better? Frameworks and Approaches for Sustainability Transitions," Sustainability, MDPI, vol. 16(2), pages 1-22, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jonas Heiberg & Christian Binz & Bernhard Truffer, 2020. "Assessing transitions through socio-technical network analysis – a methodological framework and a case study from the water sector," Papers in Evolutionary Economic Geography (PEEG) 2035, Utrecht University, Department of Human Geography and Spatial Planning, Group Economic Geography, revised Aug 2020.
    2. Edler, Jakob & Köhler, Jonathan Hugh & Wydra, Sven & Salas-Gironés, Edgar & Schiller, Katharina & Braun, Annette, 2021. "Dimensions of systems and transformations: Towards an integrated framework for system transformations," Working Papers "Sustainability and Innovation" S03/2021, Fraunhofer Institute for Systems and Innovation Research (ISI).
    3. Attila Havas & Doris Schartinger & K. Matthias Weber, 2022. "Innovation Studies, Social Innovation, and Sustainability Transitions Research: From mutual ignorance towards an integrative perspective?," CERS-IE WORKING PAPERS 2227, Institute of Economics, Centre for Economic and Regional Studies.
    4. Kivimaa, Paula & Rogge, Karoline S., 2022. "Interplay of policy experimentation and institutional change in sustainability transitions: The case of mobility as a service in Finland," Research Policy, Elsevier, vol. 51(1).
    5. Heiberg, Jonas & Truffer, Bernhard & Binz, Christian, 2022. "Assessing transitions through socio-technical configuration analysis – a methodological framework and a case study in the water sector," Research Policy, Elsevier, vol. 51(1).
    6. Edmondson, Duncan L. & Kern, Florian & Rogge, Karoline S., 2019. "The co-evolution of policy mixes and socio-technical systems: Towards a conceptual framework of policy mix feedback in sustainability transitions," Research Policy, Elsevier, vol. 48(10).
    7. Dahesh, Mehran Badin & Tabarsa, Gholamali & Zandieh, Mostafa & Hamidizadeh, Mohammadreza, 2020. "Reviewing the intellectual structure and evolution of the innovation systems approach: A social network analysis," Technology in Society, Elsevier, vol. 63(C).
    8. Jan Fagerberg & Håkon Endresen Normann, 2022. "Innovation policy, regulation and the transition to net zero," Working Papers on Innovation Studies 20220531, Centre for Technology, Innovation and Culture, University of Oslo.
    9. Wise, Emily & Arnold, Erik, 2022. "Evaluating Transformation – what can we learn from the literature?," Papers in Innovation Studies 2022/10, Lund University, CIRCLE - Centre for Innovation Research.
    10. Norouzi, F. & Hoppe, T. & Kamp, L.M. & Manktelow, C. & Bauer, P., 2023. "Diagnosis of the implementation of smart grid innovation in The Netherlands and corrective actions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 175(C).
    11. Kern, Florian & Rogge, Karoline S. & Howlett, Michael, 2019. "Policy mixes for sustainability transitions: New approaches and insights through bridging innovation and policy studies," Research Policy, Elsevier, vol. 48(10).
    12. Geels, Frank W., 2022. "Causality and explanation in socio-technical transitions research: Mobilising epistemological insights from the wider social sciences," Research Policy, Elsevier, vol. 51(6).
    13. Diercks, Gijs & Larsen, Henrik & Steward, Fred, 2019. "Transformative innovation policy: Addressing variety in an emerging policy paradigm," Research Policy, Elsevier, vol. 48(4), pages 880-894.
    14. Hilde Nykamp, 2020. "Policy Mix for a Transition to Sustainability: Green Buildings in Norway," Sustainability, MDPI, vol. 12(2), pages 1-17, January.
    15. Joanna Stryjek, 2021. "Counteracting the COVID-19 Crisis with Innovation Policy Tools: A Case Study of the EU’s Supranational Innovation Policy," European Research Studies Journal, European Research Studies Journal, vol. 0(3), pages 450-468.
    16. Weigelt, Carmen & Lu, Shaohua & Verhaal, J. Cameron, 2021. "Blinded by the sun: The role of prosumers as niche actors in incumbent firms’ adoption of solar power during sustainability transitions," Research Policy, Elsevier, vol. 50(9).
    17. Raven, Rob & Walrave, Bob, 2020. "Overcoming transformational failures through policy mixes in the dynamics of technological innovation systems," Technological Forecasting and Social Change, Elsevier, vol. 153(C).
    18. Franz Tödtling & Michaela Trippl & Veronika Desch, 2022. "New directions for RIS studies and policies in the face of grand societal challenges," European Planning Studies, Taylor & Francis Journals, vol. 30(11), pages 2139-2156, November.
    19. Mohammad Esmailzadeh & Siamak Noori & Alireza Aliahmadi & Hamidreza Nouralizadeh & Marcel Bogers, 2020. "A Functional Analysis of Technological Innovation Systems in Developing Countries: An Evaluation of Iran’s Photovoltaic Innovation System," Sustainability, MDPI, vol. 12(5), pages 1-20, March.
    20. De Oliveira, Luiz Gustavo Silva & Negro, Simona O., 2019. "Contextual structures and interaction dynamics in the Brazilian Biogas Innovation System," Renewable and Sustainable Energy Reviews, Elsevier, vol. 107(C), pages 462-481.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:52:y:2023:i:2:s0048733322001974. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.