IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v50y2021i10s0048733321001645.html
   My bibliography  Save this article

How do policy instruments generate new ones? Analysing policy instruments feedback and interaction in educational research in England, 1986-2014

Author

Listed:
  • Marques, Marcelo

Abstract

The study of research funding arrangements and the production of scientific knowledge has been marked by a lack of understanding about how research funding instruments interact and how these instruments shape policy-making and research fields. To fill this research gap, this study is theoretically supported by policy feedback and policy instruments’ interaction studies. It investigates the effects of the UK's research assessment exercise in the creation of the most emblematic national thematic research program for the field of educational research in the country – the Teaching and Learning Research Programme (TLRP). Based on qualitative analysis of policy documents and semi-structured interviews with policy-makers and boundary-spanners, this paper shows how the research assessment exercise contributed to the creation of the TLRP and how the interaction between the two policy instruments shaped the field of educational research in England. In particular, the results show a) how the institutionalisation of the research assessment led to frame a “quality problem” in educational research that legitimated several policy initiatives, including the creation of the national thematic research programme (interpretative effects) and a shift in resources allocation (resource/incentive effects); and b) how the interaction between the two policy instruments contributed to methodological and epistemic drifts in the field of educational research.

Suggested Citation

  • Marques, Marcelo, 2021. "How do policy instruments generate new ones? Analysing policy instruments feedback and interaction in educational research in England, 1986-2014," Research Policy, Elsevier, vol. 50(10).
    • Handle: RePEc:eee:respol:v:50:y:2021:i:10:s0048733321001645
    DOI: 10.1016/j.respol.2021.104367
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733321001645
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2021.104367?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Schneider, Anne & Ingram, Helen, 1993. "Social Construction of Target Populations: Implications for Politics and Policy," American Political Science Review, Cambridge University Press, vol. 87(2), pages 334-347, June.
    2. Kaare Aagaard & Carter Bloch & Jesper W. Schneider, 2015. "Impacts of performance-based research funding systems: The case of the Norwegian Publication Indicator," Research Evaluation, Oxford University Press, vol. 24(2), pages 106-117.
    3. Kern, Florian & Rogge, Karoline S. & Howlett, Michael, 2019. "Policy mixes for sustainability transitions: New approaches and insights through bridging innovation and policy studies," Research Policy, Elsevier, vol. 48(10).
    4. Aldo Geuna, 2001. "The Changing Rationale for European University Research Funding: Are There Negative Unintended Consequences?," Journal of Economic Issues, Taylor & Francis Journals, vol. 35(3), pages 607-632, September.
    5. Jonas Krog Lind, 2019. "The missing link: How university managers mediate the impact of a performance-based research funding system," Research Evaluation, Oxford University Press, vol. 28(1), pages 84-93.
    6. Frederic S. Lee, 2007. "The Research Assessment Exercise, the state and the dominance of mainstream economics in British universities," Cambridge Journal of Economics, Oxford University Press, vol. 31(2), pages 309-325, March.
    7. Katharine Barker, 2007. "The UK Research Assessment Exercise: the evolution of a national research evaluation system," Research Evaluation, Oxford University Press, vol. 16(1), pages 3-12, March.
    8. Ben R. Martin, 2016. "R&D policy instruments -- a critical review of what we do and don’t know," Industry and Innovation, Taylor & Francis Journals, vol. 23(2), pages 157-176, February.
    9. Carsten Daugbjerg & Adrian Kay, 2020. "Policy feedback and pathways: when change leads to endurance and continuity to change," Policy Sciences, Springer;Society of Policy Sciences, vol. 53(2), pages 253-268, June.
    10. Stig Slipersæter & Jean Thèves & Barend van der Meulen, 2007. "Comparing the evolution of national research policies: What patterns of change?," Science and Public Policy, Oxford University Press, vol. 34(6), pages 372-388, July.
    11. Giliberto Capano & Michael Howlett, 2020. "The Knowns and Unknowns of Policy Instrument Analysis: Policy Tools and the Current Research Agenda on Policy Mixes," SAGE Open, , vol. 10(1), pages 21582440199, January.
    12. Hee-Je Bak & Do Han Kim, 2019. "The unintended consequences of performance-based incentives on inequality in scientists’ research performance," Science and Public Policy, Oxford University Press, vol. 46(2), pages 219-231.
    13. Rogge, Karoline S. & Reichardt, Kristin, 2016. "Policy mixes for sustainability transitions: An extended concept and framework for analysis," Research Policy, Elsevier, vol. 45(8), pages 1620-1635.
    14. Arie Rip & Barend J R van der Meulen, 1996. "The post-modern research system," Science and Public Policy, Oxford University Press, vol. 23(6), pages 343-352, December.
    15. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    16. Campbell, Andrea Louise, 2002. "Self-Interest, Social Security, and the Distinctive Participation Patterns of Senior Citizens," American Political Science Review, Cambridge University Press, vol. 96(3), pages 565-574, September.
    17. Edmondson, Duncan L. & Kern, Florian & Rogge, Karoline S., 2019. "The co-evolution of policy mixes and socio-technical systems: Towards a conceptual framework of policy mix feedback in sustainability transitions," Research Policy, Elsevier, vol. 48(10).
    18. Laurens K Hessels & John Grin & Ruud E H M Smits, 2011. "The effects of a changing institutional environment on academic research practices: three cases from agricultural science," Science and Public Policy, Oxford University Press, vol. 38(7), pages 555-568, August.
    19. Laurens K Hessels & Harro van Lente & Ruud Smits, 2009. "In search of relevance: The changing contract between science and society," Science and Public Policy, Oxford University Press, vol. 36(5), pages 387-401, June.
    20. Peter Woelert & Lachlan McKenzie, 2018. "Follow the money? How Australian universities replicate national performance-based funding mechanisms," Research Evaluation, Oxford University Press, vol. 27(3), pages 184-195.
    21. Lepori, Benedetto, 2011. "Coordination modes in public funding systems," Research Policy, Elsevier, vol. 40(3), pages 355-367, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Leila Jabrane, 2022. "Individual excellence funding: effects on research autonomy and the creation of protected spaces," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-9, December.
    2. Daniella Bayle Deutz & Thea Marie Drachen & Dorte Drongstrup & Niels Opstrup & Charlotte Wien, 2021. "Quantitative quality: a study on how performance-based measures may change the publication patterns of Danish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3303-3320, April.
    3. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 9447, Victoria University of Wellington, Chair in Public Finance.
    4. Hilde Nykamp, 2020. "Policy Mix for a Transition to Sustainability: Green Buildings in Norway," Sustainability, MDPI, vol. 12(2), pages 1-17, January.
    5. Nuñez-Jimenez, Alejandro & Knoeri, Christof & Hoppmann, Joern & Hoffmann, Volker H., 2022. "Beyond innovation and deployment: Modeling the impact of technology-push and demand-pull policies in Germany's solar policy mix," Research Policy, Elsevier, vol. 51(10).
    6. Eric Brouillat & Maïder Saint Jean, 2020. "Mind the gap: Investigating the impact of implementation gaps on cleaner technology transition," Post-Print hal-03490256, HAL.
    7. Trotter, Philipp A. & Brophy, Aoife, 2022. "Policy mixes for business model innovation: The case of off-grid energy for sustainable development in sub-Saharan Africa," Research Policy, Elsevier, vol. 51(6).
    8. Kivimaa, Paula & Rogge, Karoline S., 2022. "Interplay of policy experimentation and institutional change in sustainability transitions: The case of mobility as a service in Finland," Research Policy, Elsevier, vol. 51(1).
    9. Christian Schneijderberg & Nicolai Götze & Lars Müller, 2022. "A study of 25 years of publication outputs in the German academic profession," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 1-28, January.
    10. Robert A. Buckle & John Creedy, 2022. "Methods to evaluate institutional responses to performance‐based research funding systems," Australian Economic Papers, Wiley Blackwell, vol. 61(3), pages 615-634, September.
    11. Naimeh Mohammadi & Hamid Mostofi & Hans-Liudger Dienel, 2023. "Policy Chain of Energy Transition from Economic and Innovative Perspectives: Conceptual Framework and Consistency Analysis," Sustainability, MDPI, vol. 15(17), pages 1-27, August.
    12. Vollebergh, Herman & van der Werf, Edwin & Vogel, Johanna, 2023. "A descriptive framework to evaluate instrument packages for the low-carbon transition," Ecological Economics, Elsevier, vol. 205(C).
    13. Laurens Hessels & John Grin & Smits, 2010. "Stakeholder interactions in Dutch animal sciences," Innovation Studies Utrecht (ISU) working paper series 10-02, Utrecht University, Department of Innovation Studies, revised May 2010.
    14. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 21104, Victoria University of Wellington, Chair in Public Finance.
    15. S. Andresen & G. Bang & J. B. Skjærseth & A. Underdal, 2021. "Achieving the ambitious targets of the Paris Agreement: the role of key actors," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 21(1), pages 1-7, March.
    16. Brouillat, Eric & Saint Jean, Maïder, 2020. "Mind the gap: Investigating the impact of implementation gaps on cleaner technology transition," Technological Forecasting and Social Change, Elsevier, vol. 158(C).
    17. Jon Birger Skjærseth, 2021. "Towards a European Green Deal: The evolution of EU climate and energy policy mixes," International Environmental Agreements: Politics, Law and Economics, Springer, vol. 21(1), pages 25-41, March.
    18. Laura Himanen & Hanna-Mari Puuska, 2022. "Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities," Research Evaluation, Oxford University Press, vol. 31(2), pages 236-248.
    19. Ana Fernández-Zubieta & Inés Andújar-Nagore & Sandro Giachi & Manuel Fernández-Esquinas, 2016. "New Organizational Arrangements for Public-Private Research Collaboration," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 7(1), pages 80-103, March.
    20. Robert A. Buckle & John Creedy & Norman Gemmell, 2022. "Sources of convergence and divergence in university research quality: evidence from the performance-based research funding system in New Zealand," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3021-3047, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:50:y:2021:i:10:s0048733321001645. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.