IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i11d10.1007_s11192-023-04836-w.html
   My bibliography  Save this article

What is research funding, how does it influence research, and how is it recorded? Key dimensions of variation

Author

Listed:
  • Mike Thelwall

    (University of Wolverhampton
    University of Sheffield)

  • Subreena Simrick

    (Medical Research Council)

  • Ian Viney

    (Medical Research Council)

  • Peter Van den Besselaar

    (Vrije Universiteit Amsterdam
    German Centre for Higher Education Research and Science Studies (DZHW))

Abstract

Evaluating the effects of some or all academic research funding is difficult because of the many different and overlapping sources, types, and scopes. It is therefore important to identify the key aspects of research funding so that funders and others assessing its value do not overlook them. This article outlines 18 dimensions through which funding varies substantially, as well as three funding records facets. For each dimension, a list of common or possible variations is suggested. The main dimensions include the type of funder of time and equipment, any funding sharing, the proportion of costs funded, the nature of the funding, any collaborative contributions, and the amount and duration of the grant. In addition, funding can influence what is researched, how and by whom. The funding can also be recorded in different places and has different levels of connection to outputs. The many variations and the lack of a clear divide between “unfunded” and funded research, because internal funding can be implicit or unrecorded, greatly complicate assessing the value of funding quantitatively at scale. The dimensions listed here should nevertheless help funding evaluators to consider as many differences as possible and list the remainder as limitations. They also serve as suggested information to collect for those compiling funding datasets.

Suggested Citation

  • Mike Thelwall & Subreena Simrick & Ian Viney & Peter Van den Besselaar, 2023. "What is research funding, how does it influence research, and how is it recorded? Key dimensions of variation," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(11), pages 6085-6106, November.
  • Handle: RePEc:spr:scient:v:128:y:2023:i:11:d:10.1007_s11192-023-04836-w
    DOI: 10.1007/s11192-023-04836-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04836-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-023-04836-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Jesper W. Schneider & Thed N. van Leeuwen, 2014. "Analysing robustness and uncertainty levels of bibliometric performance statistics supporting science policy. A case study evaluating Danish postdoctoral funding," Research Evaluation, Oxford University Press, vol. 23(4), pages 285-297.
    2. Yoshi-aki Shimada & Naotoshi Tsukada & Jun Suzuki, 2017. "Promoting diversity in science in Japan through mission-oriented research grants," Scientometrics, Springer;Akadémiai Kiadó, vol. 110(3), pages 1415-1435, March.
    3. Rachel Heyard & Hanna Hottenrott, 2020. "The Impact of Research Funding on Knowledge Creation and Dissemination: A study of SNSF Research Grants," Papers 2011.11274, arXiv.org, revised Aug 2021.
    4. Katie Meadmore & Kathryn Fackrell & Alejandra Recio-Saucedo & Abby Bull & Simon D S Fraser & Amanda Blatch-Jones, 2020. "Decision-making approaches used by UK and international health funding organisations for allocating research funds: A survey of current practice," PLOS ONE, Public Library of Science, vol. 15(11), pages 1-17, November.
    5. Katrin Hussinger & João N. Carvalho, 2022. "The long-term effect of research grants on the scientific output of university professors," Industry and Innovation, Taylor & Francis Journals, vol. 29(4), pages 463-487, April.
    6. Ayoubi, Charles & Pezzoni, Michele & Visentin, Fabiana, 2019. "The important thing is not to win, it is to take part: What if scientists benefit from participating in research grant competitions?," Research Policy, Elsevier, vol. 48(1), pages 84-97.
    7. Martin Schröder & Mark Lutter & Isabel M Habicht, 2021. "Publishing, signaling, social capital, and gender: Determinants of becoming a tenured professor in German political science," PLOS ONE, Public Library of Science, vol. 16(1), pages 1-19, January.
    8. Jörg Neufeld, 2016. "Determining effects of individual research grants on publication output and impact: The case of the Emmy Noether Programme (German Research Foundation)," Research Evaluation, Oxford University Press, vol. 25(1), pages 50-61.
    9. Sam Garrett-Jones, 2000. "International trends in evaluating university research outcomes: what lessons for Australia?," Research Evaluation, Oxford University Press, vol. 9(2), pages 115-124, August.
    10. van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
    11. Laudel, Grit & Gläser, Jochen, 2014. "Beyond breakthrough research: Epistemic properties of research and their consequences for research funding," Research Policy, Elsevier, vol. 43(7), pages 1204-1216.
    12. John Rigby, 2011. "Systematic grant and funding body acknowledgement data for publications: new dimensions and new controversies for research policy and evaluation," Research Evaluation, Oxford University Press, vol. 20(5), pages 365-375, December.
    13. Liv Langfeldt & Carter Walter Bloch & Gunnar Sivertsen, 2015. "Options and limitations in measuring the impact of research grants—evidence from Denmark and Norway," Research Evaluation, Oxford University Press, vol. 24(3), pages 256-270.
    14. Hottenrott, Hanna & Thorwarth, Susanne, 2010. "Industry funding of university research and scientific productivity," ZEW Discussion Papers 10-105, ZEW - Leibniz Centre for European Economic Research.
    15. Grit Laudel, 2005. "Is external research funding a valid indicator for research performance?," Research Evaluation, Oxford University Press, vol. 14(1), pages 27-34, April.
    16. Jordan A. Comins, 2015. "Data-mining the technological importance of government-funded patents in the private sector," Scientometrics, Springer;Akadémiai Kiadó, vol. 104(2), pages 425-435, August.
    17. Hicks, Diana, 2012. "Performance-based university research funding systems," Research Policy, Elsevier, vol. 41(2), pages 251-261.
    18. Grimpe, Christoph, 2012. "Extramural research grants and scientists’ funding strategies: Beggars cannot be choosers?," Research Policy, Elsevier, vol. 41(8), pages 1448-1460.
    19. Grit Laudel, 2006. "The art of getting funded: How scientists adapt to their funding conditions," Science and Public Policy, Oxford University Press, vol. 33(7), pages 489-504, August.
    20. Saeed Roshani & Mohammad-Reza Bagherylooieh & Melika Mosleh & Mario Coccia, 2021. "What is the relationship between research funding and citation-based performance? A comparative analysis between critical disciplines," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(9), pages 7859-7874, September.
    21. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    22. Hottenrott, Hanna & Lawson, Cornelia, 2017. "Fishing for complementarities: Research grants and research productivity," International Journal of Industrial Organization, Elsevier, vol. 51(C), pages 1-38.
    23. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    24. Byeongwoo Kang & Kazuyuki Motohashi, 2020. "Academic contribution to industrial innovation by funding type," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 169-193, July.
    25. Defazio, Daniela & Lockett, Andy & Wright, Mike, 2009. "Funding incentives, collaborative dynamics and scientific productivity: Evidence from the EU framework program," Research Policy, Elsevier, vol. 38(2), pages 293-305, March.
    26. Jason Gush & Adam Jaffe & Victoria Larsen & Athene Laws, 2018. "The effect of public funding on research output: the New Zealand Marsden Fund," New Zealand Economic Papers, Taylor & Francis Journals, vol. 52(2), pages 227-248, May.
    27. Stephen A Gallo & Afton S Carpenter & David Irwin & Caitlin D McPartland & Joseph Travis & Sofie Reynders & Lisa A Thompson & Scott R Glisson, 2014. "The Validation of Peer Review through Research Impact Measures and the Implications for Funding Strategies," PLOS ONE, Public Library of Science, vol. 9(9), pages 1-9, September.
    28. Kevin Gross & Carl T Bergstrom, 2019. "Contest models highlight inherent inefficiencies of scientific funding competitions," PLOS Biology, Public Library of Science, vol. 17(1), pages 1-15, January.
    29. Bol, Thijs & de Vaan, Mathijs & van de Rijt, Arnout, 2022. "Gender-equal funding rates conceal unequal evaluations," Research Policy, Elsevier, vol. 51(1).
    30. Lutter, Mark & Habicht, Isabel M. & Schröder, Martin, 2022. "Gender differences in the determinants of becoming a professor in Germany. An event history analysis of academic psychologists from 1980 to 2019," Research Policy, Elsevier, vol. 51(6).
    31. Dangzhi Zhao, 2010. "Characteristics and impact of grant-funded research: a case study of the library and information science field," Scientometrics, Springer;Akadémiai Kiadó, vol. 84(2), pages 293-306, August.
    32. Sandström, Ulf & Van den Besselaar, Peter, 2018. "Funding, evaluation, and the performance of national research systems," Journal of Informetrics, Elsevier, vol. 12(1), pages 365-384.
    33. Currie-Alder, Bruce, 2015. "Research for the Developing World: Public Funding from Australia, Canada, and the UK," OUP Catalogue, Oxford University Press, number 9780198742937, Decembrie.
    34. Isabel M. Habicht & Mark Lutter & Martin Schröder, 2021. "How human capital, universities of excellence, third party funding, mobility and gender explain productivity in German political science," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(12), pages 9649-9675, December.
    35. Peter van den Besselaar & Loet Leydesdorff, 2009. "Past performance, peer review and project selection: a case study in the social and behavioral sciences," Research Evaluation, Oxford University Press, vol. 18(4), pages 273-288, October.
    36. Thomas S. Woodson & Logan D. A. Williams, 2020. "Stronger together: inclusive innovation and undone science frameworks in the Global South," Third World Quarterly, Taylor & Francis Journals, vol. 41(11), pages 1957-1972, October.
    37. Junwen Luo & Lai Ma & Kalpana Shankar, 2021. "Does the inclusion of non-academic reviewers make any difference for grant impact panels? [Understanding the Long Term Impact of the Framework Programme, European Policy Evaluation Consortium (EPEC," Science and Public Policy, Oxford University Press, vol. 48(6), pages 763-775.
    38. Ulf Sandström, 2009. "Research quality and diversity of funding: A model for relating research money to output of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(2), pages 341-349, May.
    39. Monica Gaughan & Barry Bozeman, 2002. "Using curriculum vitae to compare some impacts of NSF research grants with research center funding," Research Evaluation, Oxford University Press, vol. 11(1), pages 17-26, April.
    40. Rachel Heyard & Hanna Hottenrott, 2021. "The value of research funding for knowledge creation and dissemination: A study of SNSF Research Grants," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    2. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    3. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," Working Papers hal-03912647, HAL.
    4. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.
    5. Álvarez-Bornstein, Belén & Bordons, María, 2021. "Is funding related to higher research impact? Exploring its relationship and the mediating role of collaboration in several disciplines," Journal of Informetrics, Elsevier, vol. 15(1).
    6. Melika Mosleh & Saeed Roshani & Mario Coccia, 2022. "Scientific laws of research funding to support citations and diffusion of knowledge in life science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1931-1951, April.
    7. Janne Pölönen & Otto Auranen, 2022. "Research performance and scholarly communication profile of competitive research funding: the case of Academy of Finland," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 7415-7433, December.
    8. Daniele Rotolo & Michael Hopkins & Nicola Grassano, 2023. "Do funding sources complement or substitute? Examining the impact of cancer research publications," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 74(1), pages 50-66, January.
    9. Rachel Heyard & Tobias Philipp & Hanna Hottenrott, 2021. "Imaginary carrot or effective fertiliser? A rejoinder on funding and productivity," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 9333-9338, November.
    10. Fernanda Morillo, 2019. "Collaboration and impact of research in different disciplines with international funding (from the EU and other foreign sources)," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 807-823, August.
    11. Li, Heyang & Wu, Meijun & Wang, Yougui & Zeng, An, 2022. "Bibliographic coupling networks reveal the advantage of diversification in scientific projects," Journal of Informetrics, Elsevier, vol. 16(3).
    12. Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
    13. Yang Ding & Fernando Moreira, 2025. "Funding and productivity: Does winning grants affect the scientific productivity of recipients? Evidence from the social sciences and economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(3), pages 1831-1870, March.
    14. Sandström, Ulf & Van den Besselaar, Peter, 2018. "Funding, evaluation, and the performance of national research systems," Journal of Informetrics, Elsevier, vol. 12(1), pages 365-384.
    15. Ryazanova, Olga & Jaskiene, Jolanta, 2022. "Managing individual research productivity in academic organizations: A review of the evidence and a path forward," Research Policy, Elsevier, vol. 51(2).
    16. Ghirelli, Corinna & Havari, Enkelejda & Meroni, Elena Claudia & Verzillo, Stefano, 2023. "The Long-Term Causal Effects of Winning an ERC Grant," IZA Discussion Papers 16108, Institute of Labor Economics (IZA).
    17. Annita Nugent & Ho Fai Chan & Uwe Dulleck, 2022. "Government funding of university-industry collaboration: exploring the impact of targeted funding on university patent activity," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 29-73, January.
    18. Gill, Chelsea & Mehrotra, Vishal & Moses, Olayinka & Bui, Binh, 2023. "The impact of the pitching research framework on AFAANZ grant applications," Pacific-Basin Finance Journal, Elsevier, vol. 77(C).
    19. Adriana Bin & Sergio Salles-Filho & Ana Carolina Spatti & Jesús Pascual Mena-Chalco & Fernando Antonio Basile Colugnati, 2022. "How much does a Ph.D. scholarship program impact an emerging economy research performance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6935-6960, December.
    20. Gill, Chelsea & Mehrotra, Vishal & Moses, Olayinka & Bui, Binh, 2024. "The impact of the Pitching Research Framework on AFAANZ grant applications: A pre-registered study," Pacific-Basin Finance Journal, Elsevier, vol. 84(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:11:d:10.1007_s11192-023-04836-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.