IDEAS home Printed from https://ideas.repec.org/a/oup/rseval/v31y2022i2p236-248..html
   My bibliography  Save this article

Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities

Author

Listed:
  • Laura Himanen
  • Hanna-Mari Puuska

Abstract

Monitoring of research performance, especially performance-based allocation of research funding inevitably creates intended and unintended incentives for universities. In this article, we study if monitoring performance acts as an incentive for improved research performance by scrutinizing the development of two essential indicators of Finnish universities’ research performance, publication output, and international competitive research funding at both national and organizational level, by combining several statistical data sources. The results are reflected to the recent changes in Finnish universities’ national funding model as well as the organizational research assessment performed in 12 universities between the years 2009 and 2019. Based on our analysis, we suggest that the incentives brought on by national and organizational level actions have not hindered the positive development in the two elements of research performance as seen in the data, and in fact the introduction of an indicator that emphasizes the quality of publication channels to the university funding model has incentivized positive development in publication counts. Universities’ research assessments seem to have no systematic influence on the developments of the two indicators under scrutiny. However, according to our analysis, research assessments in Finnish universities are conducted first and foremost for developmental reasons, so it is likely that possible changes in research performance happen during a much longer period than what our data cover.

Suggested Citation

  • Laura Himanen & Hanna-Mari Puuska, 2022. "Does monitoring performance act as an incentive for improving research performance? National and organizational level analysis of Finnish universities," Research Evaluation, Oxford University Press, vol. 31(2), pages 236-248.
  • Handle: RePEc:oup:rseval:v:31:y:2022:i:2:p:236-248.
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1093/reseval/rvac004
    Download Restriction: Access to full text is restricted to subscribers.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Kaare Aagaard & Carter Bloch & Jesper W. Schneider, 2015. "Impacts of performance-based research funding systems: The case of the Norwegian Publication Indicator," Research Evaluation, Oxford University Press, vol. 24(2), pages 106-117.
    2. Aldo Geuna, 2001. "The Changing Rationale for European University Research Funding: Are There Negative Unintended Consequences?," Journal of Economic Issues, Taylor & Francis Journals, vol. 35(3), pages 607-632, September.
    3. Jonas Krog Lind, 2019. "The missing link: How university managers mediate the impact of a performance-based research funding system," Research Evaluation, Oxford University Press, vol. 28(1), pages 84-93.
    4. Kaare Aagaard, 2015. "How incentives trickle down: Local use of a national bibliometric indicator system," Science and Public Policy, Oxford University Press, vol. 42(5), pages 725-737.
    5. Koen Jonkers & Thomas Zacharewicz, 2016. "Research Performance Based Funding Systems: a Comparative Assessment," JRC Research Reports JRC101043, Joint Research Centre.
    6. Grit Laudel, 2005. "Is external research funding a valid indicator for research performance?," Research Evaluation, Oxford University Press, vol. 14(1), pages 27-34, April.
    7. Peter Ingwersen & Birger Larsen, 2014. "Influence of a performance indicator on Danish research production and citation impact 2000–12," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(2), pages 1325-1344, November.
    8. Geuna, Aldo & Piolatto, Matteo, 2016. "Research assessment in the UK and Italy: Costly and difficult, but probably worth it (at least for a while)," Research Policy, Elsevier, vol. 45(1), pages 260-271.
    9. Peter Weingart, 2005. "Impact of bibliometrics upon the science system: Inadvertent consequences?," Scientometrics, Springer;Akadémiai Kiadó, vol. 62(1), pages 117-131, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Stephan Puehringer & Georg Wolfmayr, 2023. "Competitive Performativity of (Academic) Social Networks. The subjectivation of Competition on ResearchGate, Google Scholar and Twitter," ICAE Working Papers 150, Johannes Kepler University, Institute for Comprehensive Analysis of the Economy.
    2. Yan Xia & Jianxin You & Xiumeng Feng & Yingjie Xu & Hui Feng, 2023. "Clustering Analysis of Classified Performance Evaluation of Higher Education in Shanghai Based on Topsis Model," Sustainability, MDPI, vol. 15(8), pages 1-18, April.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Daniella Bayle Deutz & Thea Marie Drachen & Dorte Drongstrup & Niels Opstrup & Charlotte Wien, 2021. "Quantitative quality: a study on how performance-based measures may change the publication patterns of Danish researchers," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(4), pages 3303-3320, April.
    2. Linda Sīle & Raf Vanderstraeten, 2019. "Measuring changes in publication patterns in a context of performance-based research funding systems: the case of educational research in the University of Gothenburg (2005–2014)," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 71-91, January.
    3. Kulczycki, Emanuel & Korzeń, Marcin & Korytkowski, Przemysław, 2017. "Toward an excellence-based research funding system: Evidence from Poland," Journal of Informetrics, Elsevier, vol. 11(1), pages 282-298.
    4. Amara, Nabil & Rhaiem, Mehdi & Halilem, Norrin, 2020. "Assessing the research efficiency of Canadian scholars in the management field: Evidence from the DEA and fsQCA," Journal of Business Research, Elsevier, vol. 115(C), pages 296-306.
    5. Marques, Marcelo, 2021. "How do policy instruments generate new ones? Analysing policy instruments feedback and interaction in educational research in England, 1986-2014," Research Policy, Elsevier, vol. 50(10).
    6. Elea Giménez-Toledo & Jorge Mañana-Rodríguez & Tim C. E. Engels & Peter Ingwersen & Janne Pölönen & Gunnar Sivertsen & Frederik T. Verleysen & Alesia A. Zuccala, 2016. "Taking scholarly books into account: current developments in five European countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 107(2), pages 685-699, May.
    7. Mehdi Rhaiem & Nabil Amara, 2020. "Determinants of research efficiency in Canadian business schools: evidence from scholar-level data," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 53-99, October.
    8. Sven Helmer & David B. Blumenthal & Kathrin Paschen, 2020. "What is meaningful research and how should we measure it?," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(1), pages 153-169, October.
    9. Benedetto Lepori & Aldo Geuna & Valerio Veglio, 2017. "A Typology of European Research Universities. Differentiation, Layering and Resource Distribution," SPRU Working Paper Series 2017-01, SPRU - Science Policy Research Unit, University of Sussex Business School.
    10. Civera, Alice & Lehmann, Erik E. & Paleari, Stefano & Stockinger, Sarah A.E., 2020. "Higher education policy: Why hope for quality when rewarding quantity?," Research Policy, Elsevier, vol. 49(8).
    11. Giovanni Abramo & Ciriaco Andrea D’Angelo & Myroslava Hladchenko, 2023. "Assessing the effects of publication requirements for professorship on research performance and publishing behaviour of Ukrainian academics," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4589-4609, August.
    12. Christian Schneijderberg & Nicolai Götze & Lars Müller, 2022. "A study of 25 years of publication outputs in the German academic profession," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 1-28, January.
    13. Robert A. Buckle & John Creedy, 2022. "Methods to evaluate institutional responses to performance‐based research funding systems," Australian Economic Papers, Wiley Blackwell, vol. 61(3), pages 615-634, September.
    14. Benedetto, Lepori & Geuna, Aldo & Veglio, Valerio, 2017. "A Typology of European Universities. Differentiation and resource distribution," Department of Economics and Statistics Cognetti de Martiis. Working Papers 201705, University of Turin.
    15. Renata Kudaibergenova & Sandugash Uzakbay & Asselya Makanova & Kymbat Ramadinkyzy & Erlan Kistaubayev & Ruslan Dussekeev & Kadyrzhan Smagulov, 2022. "Managing publication change at Al-Farabi Kazakh National University: a case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 453-479, January.
    16. Thomas Zacharewicz & Benedetto Lepori & Emanuela Reale & Koen Jonkers, 2019. "Performance-based research funding in EU Member States—a comparative assessment," Science and Public Policy, Oxford University Press, vol. 46(1), pages 105-115.
    17. Per Ahlgren & Cristian Colliander & Olle Persson, 2012. "Field normalized citation rates, field normalized journal impact and Norwegian weights for allocation of university research funds," Scientometrics, Springer;Akadémiai Kiadó, vol. 92(3), pages 767-780, September.
    18. Sarah de Rijcke & Paul F. Wouters & Alex D. Rushforth & Thomas P. Franssen & Björn Hammarfelt, 2016. "Evaluation practices and effects of indicator use—a literature review," Research Evaluation, Oxford University Press, vol. 25(2), pages 161-169.
    19. Leila Jabrane, 2022. "Individual excellence funding: effects on research autonomy and the creation of protected spaces," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-9, December.
    20. Buehling, Kilian, 2021. "Changing research topic trends as an effect of publication rankings – The case of German economists and the Handelsblatt Ranking," Journal of Informetrics, Elsevier, vol. 15(3).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:oup:rseval:v:31:y:2022:i:2:p:236-248.. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Oxford University Press (email available below). General contact details of provider: https://academic.oup.com/rev .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.