IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v127y2022i3d10.1007_s11192-021-04232-2.html
   My bibliography  Save this article

The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs

Author

Listed:
  • Tanel Hirv

    (University of Tartu)

Abstract

This article analyzes the effect of country size, level of funding, method of financing, and ways of collaboration on scientific publication output in terms of the number of articles published and citations received in the scientific literature across national research systems. This article takes an initial step toward integrating mentioned aspects into one analysis because previously, they have been studied incoherently as separate issues. The study encompasses European countries using data provided by Clarivate Analytics, the European Commission and Eurostat. Based on the empirical analysis, three conclusions emerge. Firstly, we have to reject the proposition that the function of scientific production exhibits increasing returns to scale. Secondly, transnationally coordinated research projects have a strong positive effect on countries’ number of articles and citations. Smaller countries participate proportionally more in transnationally coordinated research and are therefore more affected by the phenomena of hyperauthorship. This explains why several small nations perform above their weight in impact relative to spending. Thirdly, the share of competitive project-based funding does not affect the number of articles published but has a U-shaped relationship with research impact per article, pointing toward two alternative financing strategies for maximizing impact based on high or low share of project-based funding. Based on the analysis, we present strengths and weaknesses of European countries’ research systems for policy purposes.

Suggested Citation

  • Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
  • Handle: RePEc:spr:scient:v:127:y:2022:i:3:d:10.1007_s11192-021-04232-2
    DOI: 10.1007/s11192-021-04232-2
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-021-04232-2
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-021-04232-2?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Avi Goldfarb & Catherine Tucker, 2019. "Digital Economics," Journal of Economic Literature, American Economic Association, vol. 57(1), pages 3-43, March.
    2. Gangan Prathap, 2017. "Scientific wealth and inequality within nations," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(2), pages 923-928, November.
    3. Benedetto Lepori & Peter van den Besselaar & Michael Dinges & Barend van der Meulen & Bianca Potì & Emanuela Reale & Stig Slipersaeter & Jean Theves, 2007. "Indicators for comparative analysis of public project funding: concepts, implementation and evaluation," Research Evaluation, Oxford University Press, vol. 16(4), pages 243-255, December.
    4. Peter Vinkler, 2018. "Structure of the scientific research and science policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 737-756, February.
    5. R. D. Shelton, 2020. "Scientometric laws connecting publication counts to national research funding," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 181-206, April.
    6. Sonia R. Zanotto & Cristina Haeffner & Jorge A. Guimarães, 2016. "Unbalanced international collaboration affects adversely the usefulness of countries’ scientific output as well as their technological and social impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(3), pages 1789-1814, December.
    7. Peter Vinkler, 2008. "Correlation between the structure of scientific research, scientometric indicators and GDP in EU and non-EU countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 74(2), pages 237-254, February.
    8. Michael R. M. Abrigo & Inessa Love, 2016. "Estimation of panel vector autoregression in Stata," Stata Journal, StataCorp LP, vol. 16(3), pages 778-804, September.
    9. Emanuela Reale, 2017. "Analysis of National Public Research Funding (PREF) - Final Report," JRC Research Reports JRC107599, Joint Research Centre.
    10. Jonathan Adams, 2012. "The rise of research networks," Nature, Nature, vol. 490(7420), pages 335-336, October.
    11. Koshal, Rajindar K. & Koshal, Manjulika, 1999. "Economies of scale and scope in higher education: a case of comprehensive universities," Economics of Education Review, Elsevier, vol. 18(2), pages 269-277, April.
    12. Zvi Griliches, 1998. "Issues in Assessing the Contribution of Research and Development to Productivity Growth," NBER Chapters, in: R&D and Productivity: The Econometric Evidence, pages 17-45, National Bureau of Economic Research, Inc.
    13. Jan van Steen, 2012. "Modes of Public Funding of Research and Development: Towards Internationally Comparable Indicators," OECD Science, Technology and Industry Working Papers 2012/4, OECD Publishing.
    14. Fisher, Franklin M & Temin, Peter, 1973. "Returns to Scale in Research and Development: What Does the Schumpeterian Hypothesis Imply ?," Journal of Political Economy, University of Chicago Press, vol. 81(1), pages 56-70, Jan.-Feb..
    15. Domingo Docampo & Jean-Jacques Bessoule, 2019. "A new approach to the analysis and evaluation of the research output of countries and institutions," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 1207-1225, May.
    16. Thijs Bol & Mathijs de Vaan & Arnout van de Rijt, 2018. "The Matthew effect in science funding," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(19), pages 4887-4890, May.
    17. Crespi, Gustavo A. & Geuna, Aldo, 2008. "An empirical study of scientific production: A cross country analysis, 1981-2002," Research Policy, Elsevier, vol. 37(4), pages 565-579, May.
    18. Blaise Cronin, 2001. "Hyperauthorship: A postmodern perversion or evidence of a structural shift in scholarly communication practices?," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 52(7), pages 558-569.
    19. Koen Jonkers & Thomas Zacharewicz, 2016. "Research Performance Based Funding Systems: a Comparative Assessment," JRC Research Reports JRC101043, Joint Research Centre.
    20. Louis-Michel Lebeau & Marie-Claude Laframboise & Vincent Larivière & Yves Gingras, 2008. "The effect of university–industry collaboration on the scientific impact of publications: the Canadian case, 1980–2005," Research Evaluation, Oxford University Press, vol. 17(3), pages 227-232, September.
    21. Patrick Herron & Aashish Mehta & Cong Cao & Timothy Lenoir, 2016. "Research diversification and impact: the case of national nanoscience development," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 629-659, November.
    22. Jonathan Adams, 2013. "The fourth age of research," Nature, Nature, vol. 497(7451), pages 557-560, May.
    23. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    24. Marianne Gauffriau & Peder Olesen Larsen & Isabelle Maye & Anne Roulin-Perriard & Markus Ins, 2007. "Publication, cooperation and productivity measures in scientific research," Scientometrics, Springer;Akadémiai Kiadó, vol. 73(2), pages 175-214, November.
    25. Auranen, Otto & Nieminen, Mika, 2010. "University research funding and publication performance--An international comparison," Research Policy, Elsevier, vol. 39(6), pages 822-834, July.
    26. Grit Laudel, 2006. "The art of getting funded: How scientists adapt to their funding conditions," Science and Public Policy, Oxford University Press, vol. 33(7), pages 489-504, August.
    27. Marcel Clermont & Alexander Dirksen & Harald Dyckhoff, 2015. "Returns to scale of Business Administration research in Germany," Scientometrics, Springer;Akadémiai Kiadó, vol. 103(2), pages 583-614, May.
    28. Christoph Emanuel Mueller, 2016. "Accurate forecast of countries’ research output by macro-level indicators," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1307-1328, November.
    29. Marta Cocos & Benedetto Lepori, 2020. "What we know about research policy mix," Science and Public Policy, Oxford University Press, vol. 47(2), pages 235-245.
    30. Leydesdorff, Loet & Wagner, Caroline, 2009. "Macro-level indicators of the relations between research funding and research output," Journal of Informetrics, Elsevier, vol. 3(4), pages 353-362.
    31. Kevin Gross & Carl T Bergstrom, 2019. "Contest models highlight inherent inefficiencies of scientific funding competitions," PLOS Biology, Public Library of Science, vol. 17(1), pages 1-15, January.
    32. Koen Jonkers & Thomas Zacharewicz, 2015. "Performance based funding: a comparative assessment of their use and nature in EU Member States – a working paper," JRC Research Reports JRC97684, Joint Research Centre.
    33. Sandström, Ulf & Van den Besselaar, Peter, 2018. "Funding, evaluation, and the performance of national research systems," Journal of Informetrics, Elsevier, vol. 12(1), pages 365-384.
    34. Varvara Trachana, 2013. "Austerity-led brain drain is killing Greek science," Nature, Nature, vol. 496(7445), pages 271-271, April.
    35. David A. King, 2004. "The scientific impact of nations," Nature, Nature, vol. 430(6997), pages 311-316, July.
    36. Richard R. Nelson, 1959. "The Simple Economics of Basic Scientific Research," Journal of Political Economy, University of Chicago Press, vol. 67, pages 297-297.
    37. Andrea Bonaccorsi & Cinzia Daraio, 2005. "Exploring size and agglomeration effects on public research productivity," Scientometrics, Springer;Akadémiai Kiadó, vol. 63(1), pages 87-120, March.
    38. Seema Sharma & V. J. Thomas, 2008. "Inter-country R&D efficiency analysis: An application of data envelopment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 76(3), pages 483-501, September.
    39. Bloch, Carter & Ryan, Thomas K. & Andersen, Jens Peter, 2019. "Public-private collaboration and scientific impact: An analysis based on Danish publication data for 1995–2013," Journal of Informetrics, Elsevier, vol. 13(2), pages 593-604.
    40. Vincent Larivière & Yves Gingras & Cassidy R. Sugimoto & Andrew Tsou, 2015. "Team size matters: Collaboration and scientific impact since 1900," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 66(7), pages 1323-1332, July.
    41. Thed N. Van Leeuwen & Henk F. Moed & Robert J. W. Tijssen & Martijn S. Visser & Anthony F. J. Van Raan, 2001. "Language biases in the coverage of the Science Citation Index and its consequencesfor international comparisons of national research performance," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 335-346, April.
    42. Michael R.M. Abrigo & Inessa Love, 2016. "Estimation of Panel Vector Autoregression in Stata: a Package of Programs," Working Papers 201602, University of Hawaii at Manoa, Department of Economics.
    43. David N. Laband & Bernard F. Lentz, 2003. "New Estimates of Economies of Scale and Scope in Higher Education," Southern Economic Journal, John Wiley & Sons, vol. 70(1), pages 172-183, July.
    44. Marianne Gauffriau & Peder Olesen Larsen, 2005. "Counting methods are decisive for rankings based on publication and citation studies," Scientometrics, Springer;Akadémiai Kiadó, vol. 64(1), pages 85-93, July.
    45. Julita Jabłecka & Karel Sima & Kadri Ukrainski, 2009. "Comparing the organization of public research funding in central and eastern European countries," Science and Public Policy, Oxford University Press, vol. 36(9), pages 667-681, November.
    46. Oecd, 2018. "Effective operation of competitive research funding systems," OECD Science, Technology and Industry Policy Papers 57, OECD Publishing.
    47. Wolfgang Glänzel, 2001. "National characteristics in international scientific co-authorship relations," Scientometrics, Springer;Akadémiai Kiadó, vol. 51(1), pages 69-115, April.
    48. Lutz Bornmann & Robin Haunschild, 2017. "Does evaluative scientometrics lose its main focus on scientific quality by the new orientation towards societal impact?," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(2), pages 937-943, February.
    49. Fernanda Morillo, 2016. "Public–private interactions reflected through the funding acknowledgements," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(3), pages 1193-1204, September.
    50. José Manuel Pastor & Lorenzo Serrano, 2016. "The determinants of the research output of universities: specialization, quality and inefficiencies," Scientometrics, Springer;Akadémiai Kiadó, vol. 109(2), pages 1255-1281, November.
    51. Lepori, Benedetto, 2011. "Coordination modes in public funding systems," Research Policy, Elsevier, vol. 40(3), pages 355-367, April.
    52. Jiancheng Guan & Kairui Zuo, 2014. "A cross-country comparison of innovation efficiency," Scientometrics, Springer;Akadémiai Kiadó, vol. 100(2), pages 541-575, August.
    53. Ernesto R. Gantman, 2012. "Economic, linguistic, and political factors in the scientific productivity of countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 967-985, December.
    54. Caroline S. Wagner & Koen Jonkers, 2017. "Open countries have strong science," Nature, Nature, vol. 550(7674), pages 32-33, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Alonso Rodríguez-Navarro & Ricardo Brito, 2022. "The link between countries’ economic and scientific wealth has a complex dependence on technological activity and research policy," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2871-2896, May.
    2. Elham Erfanian & Amir B. Ferreira Neto, 2017. "Scientific output: labor or capital intensive? An analysis for selected countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 461-482, July.
    3. Waltman, Ludo, 2016. "A review of the literature on citation impact indicators," Journal of Informetrics, Elsevier, vol. 10(2), pages 365-391.
    4. Sandström, Ulf & Van den Besselaar, Peter, 2018. "Funding, evaluation, and the performance of national research systems," Journal of Informetrics, Elsevier, vol. 12(1), pages 365-384.
    5. Zaida Chinchilla-Rodríguez & Cassidy R Sugimoto & Vincent Larivière, 2019. "Follow the leader: On the relationship between leadership and scholarly impact in international collaborations," PLOS ONE, Public Library of Science, vol. 14(6), pages 1-18, June.
    6. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2021. "The scholarly impact of private sector research: A multivariate analysis," Journal of Informetrics, Elsevier, vol. 15(3).
    7. Giovanni Abramo & Ciriaco Andrea D'Angelo & Flavia Di Costa, 2020. "The relative impact of private research on scientific advancement," Papers 2012.04908, arXiv.org.
    8. Jeffrey Demaine, 2022. "Fractionalization of research impact reveals global trends in university collaboration," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(5), pages 2235-2247, May.
    9. Carmen Osuna & Laura Cruz Castro & Luis Sanz Menéndez, 2010. "Knocking down some Assumptions about the Effects of Evaluation Systems on Publications," Working Papers 1010, Instituto de Políticas y Bienes Públicos (IPP), CSIC.
    10. Khosrowjerdi, Mahmood & Bornmann, Lutz, 2021. "Is culture related to strong science? An empirical investigation," Journal of Informetrics, Elsevier, vol. 15(4).
    11. Sakiru Adebola Solarin & Yuen Yee Yen, 2016. "A global analysis of the impact of research output on economic growth," Scientometrics, Springer;Akadémiai Kiadó, vol. 108(2), pages 855-874, August.
    12. Thomas, Duncan Andrew & Ramos-Vielba, Irene, 2022. "Reframing study of research(er) funding towards configurations and trails," SocArXiv uty2v, Center for Open Science.
    13. Abramo, Giovanni & D'Angelo, Ciriaco Andrea & Di Costa, Flavia, 2022. "Revealing the scientific comparative advantage of nations: Common and distinctive features," Journal of Informetrics, Elsevier, vol. 16(1).
    14. Alona Zharova & Wolfgang K. Härdle & Stefan Lessmann, 2017. "Is Scientific Performance a Function of Funds?," SFB 649 Discussion Papers SFB649DP2017-028, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    15. Courtioux, Pierre & Métivier, François & Rebérioux, Antoine, 2022. "Nations ranking in scientific competition: Countries get what they paid for," Economic Modelling, Elsevier, vol. 116(C).
    16. Confraria, Hugo & Mira Godinho, Manuel & Wang, Lili, 2017. "Determinants of citation impact: A comparative analysis of the Global South versus the Global North," Research Policy, Elsevier, vol. 46(1), pages 265-279.
    17. Elham Erfanian & Amir B. Ferreira Neto, 2017. "Scientific output: labor or capital intensive? An analysis for selected countries," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(1), pages 461-482, July.
    18. Osório, António (António Miguel), 2019. "The value and credits of n-authors publications," Working Papers 2072/376026, Universitat Rovira i Virgili, Department of Economics.
    19. Pär Sundling, 2023. "Author contributions and allocation of authorship credit: testing the validity of different counting methods in the field of chemical biology," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2737-2762, May.
    20. Zharova, Alona & Härdle, Wolfgang Karl & Lessmann, Stefan, 2023. "Data-driven support for policy and decision-making in university research management: A case study from Germany," European Journal of Operational Research, Elsevier, vol. 308(1), pages 353-368.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:127:y:2022:i:3:d:10.1007_s11192-021-04232-2. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.