IDEAS home Printed from https://ideas.repec.org/a/oup/scippl/v46y2019i1p105-115..html
   My bibliography  Save this article

Performance-based research funding in EU Member States—a comparative assessment

Author

Listed:
  • Thomas Zacharewicz
  • Benedetto Lepori
  • Emanuela Reale
  • Koen Jonkers

Abstract

Performance-based research funding (PBRF), the allocation of institutional funding on the basis of ex post assessments of university research performance, has been implemented in a large number of EU Member States. However, the characteristics of this funding scheme differ widely. Apart from differences in the volume of funding, there are major variations in the assessments that feed into the funding allocation formula. Even within the two main groups of metrics based and peer review-based assessments the approaches adopted vary. Some of the main strengths and drawbacks of the various options are discussed in this article. An analysis of national Global Budgetary Allocations for R&D data reveals the distribution of project and institutional funding and the potential for PBRF. Given the heterogeneity of performance-based funding approaches, a comprehensive comparative assessment of the funding involved in this instrument requires further work. Nonetheless Member State governments can engage in institutional learning from good practices.

Suggested Citation

  • Thomas Zacharewicz & Benedetto Lepori & Emanuela Reale & Koen Jonkers, 2019. "Performance-based research funding in EU Member States—a comparative assessment," Science and Public Policy, Oxford University Press, vol. 46(1), pages 105-115.
    • Handle: RePEc:oup:scippl:v:46:y:2019:i:1:p:105-115.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/scipol/scy041
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Merle Jacob, 2015. "RIO Country Report Sweden 2014," JRC Research Reports JRC96470, Joint Research Centre.
    2. Srholec Martin & Szkuta Katarzyna, 2016. "RIO Country Report 2015: Czech Republic," JRC Research Reports JRC101175, Joint Research Centre.
    3. Pierre Bitard, 2015. "RIO Country Report France 2014," JRC Research Reports JRC96577, Joint Research Centre.
    4. Aldo Geuna, 2001. "The Changing Rationale for European University Research Funding: Are There Negative Unintended Consequences?," Journal of Economic Issues, Taylor & Francis Journals, vol. 35(3), pages 607-632, September.
    5. Paul Cunningham, 2015. "RIO Country Report UK 2014," JRC Research Reports JRC96565, Joint Research Centre.
    6. Todorova Angelina & Slavcheva Milena, 2016. "RIO Country Report 2015: Bulgaria," JRC Research Reports JRC101136, Joint Research Centre.
    7. Dory Tibor & Milena Slavcheva, 2016. "RIO Country Report 2015: Hungary," JRC Research Reports JRC101194, Joint Research Centre.
    8. Agne Paliokaite, 2015. "RIO Country Report Lithuania 2014," JRC Research Reports JRC96488, Joint Research Centre.
    9. Jesper W. Schneider & Kaare Aagaard & Carter W. Bloch, 2016. "What happens when national research funding is linked to differentiated publication counts? A comparison of the Australian and Norwegian publication-based funding models," Research Evaluation, Oxford University Press, vol. 25(3), pages 244-256.
    10. Martin Srholec & Cristiana Benedetti Fasil, 2017. "RIO Country Report 2016: Czech Republic," JRC Research Reports JRC105858, Joint Research Centre.
    11. Geuna, Aldo & Piolatto, Matteo, 2016. "Research assessment in the UK and Italy: Costly and difficult, but probably worth it (at least for a while)," Research Policy, Elsevier, vol. 45(1), pages 260-271.
    12. Gemma E. Derrick & Vincenzo Pavone, 2013. "Democratising research evaluation: Achieving greater public engagement with bibliometrics-informed peer review," Science and Public Policy, Oxford University Press, vol. 40(5), pages 563-575, April.
    13. Krzysztof Klincewicz, 2015. "RIO Country Report Poland 2014," JRC Research Reports JRC96343, Joint Research Centre.
    14. Emanuela Reale, 2017. "Analysis of National Public Research Funding (PREF) - Final Report," JRC Research Reports JRC107599, Joint Research Centre.
    15. Ana Fernandez Zubieta, 2015. "RIO Country Report Spain 2014," JRC Research Reports JRC96471, Joint Research Centre.
    16. Espen Solberg, 2016. "RIO Country Report 2015: Norway," JRC Research Reports JRC101206, Joint Research Centre.
    17. Tsipouri Lena & Athanasopoulou Sophia & Gampfer Robert, 2016. "RIO Country Report 2015: Greece," JRC Research Reports JRC101186, Joint Research Centre.
    18. Butler, Linda, 2003. "Explaining Australia's increased share of ISI publications--the effects of a funding formula based on publication counts," Research Policy, Elsevier, vol. 32(1), pages 143-155, January.
    19. Susan Alexander & Slavcheva Milena, 2016. "RIO Country Report 2015: Luxembourg," JRC Research Reports JRC101201, Joint Research Centre.
    20. Koen Jonkers & Robert Tijssen & Athina Karvounaraki & Xabier Goenaga Beldarrain, 2018. "A Regional Innovation Impact Assessment Framework for universities," JRC Research Reports JRC109020, Joint Research Centre.
    21. Susan Alexander, 2015. "RIO Country Report Luxembourg 2014," JRC Research Reports JRC96484, Joint Research Centre.
    22. Brian Warrington, 2015. "RIO Country Report Malta 2014," JRC Research Reports JRC96367, Joint Research Centre.
    23. van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
    24. Benedetto Lepori, 2017. "Analysis of National Public Research Funding (PREF) - Handbook for Data Collection and indicators production," JRC Research Reports JRC107600, Joint Research Centre.
    25. Rinia, E. J. & van Leeuwen, Th. N. & van Vuren, H. G. & van Raan, A. F. J., 2001. "Influence of interdisciplinarity on peer-review and bibliometric evaluations in physics research," Research Policy, Elsevier, vol. 30(3), pages 357-361, March.
    26. Alexander Cuntz, 2015. "RIO Country Report Austria 2014," JRC Research Reports JRC96293, Joint Research Centre.
    27. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    28. Veli-Pekka Saarnivaara, 2015. "RIO Country Report Finland 2014," JRC Research Reports JRC96563, Joint Research Centre.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mehmet Pinar, 2023. "Do research performances of universities and disciplines in England converge or diverge? An assessment of the progress between research excellence frameworks in 2014 and 2021," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(10), pages 5731-5766, October.
    2. Song Jing & Qingzhao Ma & Siyi Wang & Hanliang Xu & Tian Xu & Xia Guo & Zhuolin Wu, 2024. "Research on developmental evaluation based on the "four abilities" model: evidence from early career researchers in China," Quality & Quantity: International Journal of Methodology, Springer, vol. 58(1), pages 681-704, February.
    3. Ralf C Buckley, 2022. "Stakeholder controls and conflicts in research funding and publication," PLOS ONE, Public Library of Science, vol. 17(3), pages 1-8, March.
    4. Saarela, Mirka & Kärkkäinen, Tommi, 2020. "Can we automate expert-based journal rankings? Analysis of the Finnish publication indicator," Journal of Informetrics, Elsevier, vol. 14(2).
    5. Ajab Khan & Ali Sina Önder & Sercan Özcan, 2023. "Does Performance-based Public Funding Pay off? UK’s Research Excellence Framework (REF) and Research Productivity," Working Papers in Economics & Finance 2023-08, University of Portsmouth, Portsmouth Business School, Economics and Finance Subject Group.
    6. Banal-Estañol, Albert & Jofre-Bonet, Mireia & Iori, Giulia & Maynou, Laia & Tumminello, Michele & Vassallo, Pietro, 2023. "Performance-based research funding: Evidence from the largest natural experiment worldwide," Research Policy, Elsevier, vol. 52(6).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Robert A. Buckle & John Creedy, 2022. "Methods to evaluate institutional responses to performance‐based research funding systems," Australian Economic Papers, Wiley Blackwell, vol. 61(3), pages 615-634, September.
    2. Abramo, Giovanni & D’Angelo, Ciriaco Andrea & Di Costa, Flavia, 2019. "When research assessment exercises leave room for opportunistic behavior by the subjects under evaluation," Journal of Informetrics, Elsevier, vol. 13(3), pages 830-840.
    3. Przemysław Korytkowski & Emanuel Kulczycki, 2019. "Examining how country-level science policy shapes publication patterns: the case of Poland," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(3), pages 1519-1543, June.
    4. Groen-Xu, Moqi & Bös, Gregor & Teixeira, Pedro A. & Voigt, Thomas & Knapp, Bernhard, 2023. "Short-term incentives of research evaluations: Evidence from the UK Research Excellence Framework," Research Policy, Elsevier, vol. 52(6).
    5. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Grilli, Leonardo, 2021. "The effects of citation-based research evaluation schemes on self-citation behavior," Journal of Informetrics, Elsevier, vol. 15(4).
    6. Benedetto Lepori & Aldo Geuna & Valerio Veglio, 2017. "A Typology of European Research Universities. Differentiation, Layering and Resource Distribution," SPRU Working Paper Series 2017-01, SPRU - Science Policy Research Unit, University of Sussex Business School.
    7. Civera, Alice & Lehmann, Erik E. & Paleari, Stefano & Stockinger, Sarah A.E., 2020. "Higher education policy: Why hope for quality when rewarding quantity?," Research Policy, Elsevier, vol. 49(8).
    8. van den Besselaar, Peter & Heyman, Ulf & Sandström, Ulf, 2017. "Perverse effects of output-based research funding? Butler’s Australian case revisited," Journal of Informetrics, Elsevier, vol. 11(3), pages 905-918.
    9. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    10. Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017. "A Typology of European Universities. Differentiation and resource distribution," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201705, University of Turin.
    11. Dzieżyc, Maciej & Kazienko, Przemysław, 2022. "Effectiveness of research grants funded by European Research Council and Polish National Science Centre," Journal of Informetrics, Elsevier, vol. 16(1).
    12. Sergey Kolesnikov & Eriko Fukumoto & Barry Bozeman, 2018. "Researchers’ risk-smoothing publication strategies: Is productivity the enemy of impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 1995-2017, September.
    13. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 21104, Victoria University of Wellington, Chair in Public Finance.
    14. Ajab Khan & Ali Sina Önder & Sercan Özcan, 2023. "Does Performance-based Public Funding Pay off? UK’s Research Excellence Framework (REF) and Research Productivity," Working Papers in Economics & Finance 2023-08, University of Portsmouth, Portsmouth Business School, Economics and Finance Subject Group.
    15. Banal-Estañol, Albert & Jofre-Bonet, Mireia & Iori, Giulia & Maynou, Laia & Tumminello, Michele & Vassallo, Pietro, 2023. "Performance-based research funding: Evidence from the largest natural experiment worldwide," Research Policy, Elsevier, vol. 52(6).
    16. Daniele Rotolo & Michael Hopkins & Nicola Grassano, 2023. "Do funding sources complement or substitute? Examining the impact of cancer research publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 50-66, January.
    17. Selcuk Besir Demir, 2018. "Pros and cons of the new financial support policy for Turkish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 116(3), pages 2053-2068, September.
    18. Domenico A. Maisano & Luca Mastrogiacomo & Fiorenzo Franceschini, 2020. "Short-term effects of non-competitive funding to single academic researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(3), pages 1261-1280, June.
    19. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    20. Buckle, Robert A. & Creedy, John & Ball, Ashley, 2020. "A Schumpeterian Gale: Using Longitudinal Data to Evaluate Responses to Performance-Based Research Funding Systems," Working Paper Series 9447, Victoria University of Wellington, Chair in Public Finance.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:scippl:v:46:y:2019:i:1:p:105-115.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/spp .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.