IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v130y2025i3d10.1007_s11192-025-05277-3.html
   My bibliography  Save this article

Funding and productivity: Does winning grants affect the scientific productivity of recipients? Evidence from the social sciences and economics

Author

Listed:
  • Yang Ding

    (University of Edinburgh Business School)

  • Fernando Moreira

    (University of Edinburgh Business School)

Abstract

There is always controversy over the effects of research funding on scientific productivity. This study contributes to the literature investigating the observed effects of scientific funding. On a sample of 11537 principal investigators funded by the National Science Foundation’s Directorate for Social, Behavioral and Economic Sciences, we used a multiple time period doubly robust difference-in-differences model and a selection model of research funding with exclusion restrictions to explore funding effects. In the models, we controlled for recipient fixed effects and time-varying effects, accounting for the heterogeneity of funding and isolating selection bias and reverse causality in funding. Meanwhile, we observed the dynamic effects of grants after award. We found that the non-randomness and heterogeneity of science grant allocations can lead to endogeneity issues that contribute to the pseudo effects of science grants. However, when we considered these issues, grants’ effects on scientific productivity disappeared. Furthermore, when observing the funding effect dynamically, there remained no significant impact of research funding on the quality and quantity of research in the post-grant 5-year window.

Suggested Citation

  • Yang Ding & Fernando Moreira, 2025. "Funding and productivity: Does winning grants affect the scientific productivity of recipients? Evidence from the social sciences and economics," Scientometrics, Springer;Akadémiai Kiadó, vol. 130(3), pages 1831-1870, March.
  • Handle: RePEc:spr:scient:v:130:y:2025:i:3:d:10.1007_s11192-025-05277-3
    DOI: 10.1007/s11192-025-05277-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-025-05277-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-025-05277-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ina Ganguli, 2017. "Saving Soviet Science: The Impact of Grants When Government R&D Funding Disappears," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 165-201, April.
    2. Beaudry, Catherine & Larivière, Vincent, 2016. "Which gender gap? Factors affecting researchers’ scientific impact in science and medicine," Research Policy, Elsevier, vol. 45(9), pages 1790-1817.
    3. Clément de Chaisemartin & Xavier D'Haultfœuille, 2020. "Two-Way Fixed Effects Estimators with Heterogeneous Treatment Effects," American Economic Review, American Economic Association, vol. 110(9), pages 2964-2996, September.
    4. Benavente, José Miguel & Crespi, Gustavo & Figal Garone, Lucas & Maffioli, Alessandro, 2012. "The impact of national research funds: A regression discontinuity approach to the Chilean FONDECYT," Research Policy, Elsevier, vol. 41(8), pages 1461-1475.
    5. Marek Kwiek & Wojciech Roszka, 2022. "Academic vs. biological age in research on academic careers: a large-scale study with implications for scientifically developing systems," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3543-3575, June.
    6. George J. Borjas, 2021. "Ethnic Capital And Intergenerational Mobility," World Scientific Book Chapters, in: Foundational Essays in Immigration Economics, chapter 6, pages 107-134, World Scientific Publishing Co. Pte. Ltd..
    7. Loet Leydesdorff & Lutz Bornmann & Caroline S. Wagner, 2019. "The Relative Influences of Government Funding and International Collaboration on Citation Impact," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 70(2), pages 198-201, February.
    8. Joshua L Rosenbloom & Donna K Ginther & Ted Juhl & Joseph A Heppert, 2015. "The Effects of Research & Development Funding on Scientific Productivity: Academic Chemistry, 1990-2009," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-23, September.
    9. Marko Sarstedt & Christian Ringle, 2010. "Treating unobserved heterogeneity in PLS path modeling: a comparison of FIMIX-PLS with different data analysis strategies," Journal of Applied Statistics, Taylor & Francis Journals, vol. 37(8), pages 1299-1318.
    10. Wang, Jian & Veugelers, Reinhilde & Stephan, Paula, 2017. "Bias against novelty in science: A cautionary tale for users of bibliometric indicators," Research Policy, Elsevier, vol. 46(8), pages 1416-1436.
    11. Davies, Benjamin & Gush, Jason & Hendy, Shaun C. & Jaffe, Adam B., 2022. "Research funding and collaboration," Research Policy, Elsevier, vol. 51(2).
    12. Stephan, Paula E., 2010. "The Economics of Science," Handbook of the Economics of Innovation, in: Bronwyn H. Hall & Nathan Rosenberg (ed.), Handbook of the Economics of Innovation, edition 1, volume 1, chapter 0, pages 217-273, Elsevier.
    13. Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019. "Evaluation in research funding agencies: Are structurally diverse teams biased against?," Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
    14. C de Chaisemartin & X D’HaultfŒuille, 2018. "Fuzzy Differences-in-Differences," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 85(2), pages 999-1028.
    15. Panagiotis Lazaridis, 2004. "Demand elasticities derived from consistent estimation of Heckman-type models," Applied Economics Letters, Taylor & Francis Journals, vol. 11(8), pages 523-527.
    16. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    17. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    18. Adam B. Jaffe, 2002. "Building Programme Evaluation into the Design of Public Research-Support Programmes," Oxford Review of Economic Policy, Oxford University Press and Oxford Review of Economic Policy Limited, vol. 18(1), pages 22-34, Spring.
    19. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of NIH postdoctoral training grants on scientific productivity," Research Policy, Elsevier, vol. 40(6), pages 864-874, July.
    20. D'Este, P. & Patel, P., 2007. "University-industry linkages in the UK: What are the factors underlying the variety of interactions with industry?," Research Policy, Elsevier, vol. 36(9), pages 1295-1313, November.
    21. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    22. Stijn Kelchtermans & Daniel Neicu & Reinhilde Veugelers, 2022. "Off the beaten path: what drives scientists’ entry into new fields? [Collaboration, Stars, and the Changing Organization of Science: Evidence from Evolutionary Biology (Working Paper No. 19653)]," Industrial and Corporate Change, Oxford University Press and the Associazione ICC, vol. 31(3), pages 654-680.
    23. John P. A. Ioannidis, 2011. "Fund people not projects," Nature, Nature, vol. 477(7366), pages 529-531, September.
    24. Ashish Arora & Alfonso Gambardella, 2010. "The Impact of NSF Support for Basic Research in Economics," NBER Chapters, in: Contributions in Memory of Zvi Griliches, pages 91-115, National Bureau of Economic Research, Inc.
    25. Enrico Vanino & Stephen Roper & Bettina Becker, 2020. "Knowledge to Money: Assessing the Business Performance Effects of Publicly Funded R&D Grants," ifo DICE Report, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, vol. 17(04), pages 20-24, January.
    26. Susan Athey & Guido W. Imbens, 2006. "Identification and Inference in Nonlinear Difference-in-Differences Models," Econometrica, Econometric Society, vol. 74(2), pages 431-497, March.
    27. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    28. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    29. van den Besselaar, Peter & Mom, Charlie, 2022. "The effect of writing style on success in grant applications," Journal of Informetrics, Elsevier, vol. 16(1).
    30. Van Looy, Bart & Callaert, Julie & Debackere, Koenraad, 2006. "Publication and patent behavior of academic researchers: Conflicting, reinforcing or merely co-existing?," Research Policy, Elsevier, vol. 35(4), pages 596-608, May.
    31. Hottenrott, Hanna & Thorwarth, Susanne, 2010. "Industry funding of university research and scientific productivity," ZEW Discussion Papers 10-105, ZEW - Leibniz Centre for European Economic Research.
    32. Anthony Howell, 2022. "Socio-economic impacts of scaling back a massive payments for ecosystem services programme in China," Nature Human Behaviour, Nature, vol. 6(9), pages 1218-1225, September.
    33. Hu, Beibei & Ding, Yang & Dong, Xianlei & Bu, Yi & Ding, Ying, 2021. "On the relationship between download and citation counts: An introduction of Granger-causality inference," Journal of Informetrics, Elsevier, vol. 15(2).
    34. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Correction to: Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 907-908, January.
    35. Heckman, James, 2013. "Sample selection bias as a specification error," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 31(3), pages 129-137.
    36. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    37. Kyle Myers, 2020. "The Elasticity of Science," American Economic Journal: Applied Economics, American Economic Association, vol. 12(4), pages 103-134, October.
    38. Paula Bustos, 2011. "Trade Liberalization, Exports, and Technology Upgrading: Evidence on the Impact of MERCOSUR on Argentinian Firms," American Economic Review, American Economic Association, vol. 101(1), pages 304-340, February.
    39. Győrffy, Balázs & Herman, Péter & Szabó, István, 2020. "Research funding: past performance is a stronger predictor of future scientific output than reviewer scores," Journal of Informetrics, Elsevier, vol. 14(3).
    40. Beaudry, Catherine & Allaoui, Sedki, 2012. "Impact of public and private research funding on scientific production: The case of nanotechnology," Research Policy, Elsevier, vol. 41(9), pages 1589-1606.
    41. Haeussler, Carolin & Assmus, Anne, 2021. "Bridging the gap between invention and innovation: Increasing success rates in publicly and industry-funded clinical trials," Research Policy, Elsevier, vol. 50(2).
    42. Erjia Yan & Chaojiang Wu & Min Song, 2018. "The funding factor: a cross-disciplinary examination of the association between research funding and citation impact," Scientometrics, Springer;Akadémiai Kiadó, vol. 115(1), pages 369-384, April.
    43. Hottenrott, Hanna & Lawson, Cornelia, 2017. "Fishing for complementarities: Research grants and research productivity," International Journal of Industrial Organization, Elsevier, vol. 51(C), pages 1-38.
    44. Melika Mosleh & Saeed Roshani & Mario Coccia, 2022. "Scientific laws of research funding to support citations and diffusion of knowledge in life science," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1931-1951, April.
    45. Yu, Nannan & Dong, Yueyan & de Jong, Martin, 2022. "A helping hand from the government? How public research funding affects academic output in less-prestigious universities in China," Research Policy, Elsevier, vol. 51(10).
    46. Ashkan Ebadi & Andrea Schiffauerova, 2016. "How to boost scientific production? A statistical analysis of research funding and other influencing factors," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(3), pages 1093-1116, March.
    47. Jason Gush & Adam Jaffe & Victoria Larsen & Athene Laws, 2018. "The effect of public funding on research output: the New Zealand Marsden Fund," New Zealand Economic Papers, Taylor & Francis Journals, vol. 52(2), pages 227-248, May.
    48. Goodman-Bacon, Andrew, 2021. "Difference-in-differences with variation in treatment timing," Journal of Econometrics, Elsevier, vol. 225(2), pages 254-277.
    49. Yang, Alex J., 2024. "Unveiling the impact and dual innovation of funded research," Journal of Informetrics, Elsevier, vol. 18(1).
    50. Daniel Chudnovsky & Andrés López & Martín A. Rossi & Diego Ubfal, 2008. "Money for Science? The Impact of Research Grants on Academic Output," Fiscal Studies, Institute for Fiscal Studies, vol. 29(1), pages 75-87, March.
    51. John P. Walsh & Wei Hong, 2003. "Secrecy is increasing in step with competition," Nature, Nature, vol. 422(6934), pages 801-802, April.
    52. Yang Ning & Sida Peng & Jing Tao, 2020. "Doubly Robust Semiparametric Difference-in-Differences Estimators with High-Dimensional Data," Papers 2009.03151, arXiv.org.
    53. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    54. Baptiste Bedessem, 2020. "Should we fund research randomly? An epistemological criticism of the lottery model as an alternative to peer review for the funding of science," Research Evaluation, Oxford University Press, vol. 29(2), pages 150-157.
    55. Grossmann, Igor & Rotella, Amanda A. & Hutcherson, Cendri & Sharpinskyi, Konstantyn & Varnum, Michael E. W. & Achter, Sebastian K. & Dhami, Mandeep & Guo, Xinqi Evie & Kara-Yakoubian, Mane R. & Mandel, 2023. "Insights into the accuracy of social scientists' forecasts of societal change," Other publications TiSEM c14f4a4a-b105-46b3-90f7-f, Tilburg University, School of Economics and Management.
    56. Kevin J. Boudreau & Eva C. Guinan & Karim R. Lakhani & Christoph Riedl, 2016. "Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science," Management Science, INFORMS, vol. 62(10), pages 2765-2783, October.
    57. Baker, Andrew C. & Larcker, David F. & Wang, Charles C.Y., 2022. "How much should we trust staggered difference-in-differences estimates?," Journal of Financial Economics, Elsevier, vol. 144(2), pages 370-395.
    58. Shih, Tommy, 2024. "The role of research funders in providing directions for managing responsible internationalization and research security," Technological Forecasting and Social Change, Elsevier, vol. 201(C).
    59. repec:adr:anecst:y:2005:i:79-80:p:04 is not listed on IDEAS
    60. Alberto Martín-Martín & Mike Thelwall & Enrique Orduna-Malea & Emilio Delgado López-Cózar, 2021. "Google Scholar, Microsoft Academic, Scopus, Dimensions, Web of Science, and OpenCitations’ COCI: a multidisciplinary comparison of coverage via citations," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(1), pages 871-906, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ghirelli, Corinna & Havari, Enkelejda & Meroni, Elena Claudia & Verzillo, Stefano, 2023. "The Long-Term Causal Effects of Winning an ERC Grant," IZA Discussion Papers 16108, Institute of Labor Economics (IZA).
    2. Li, Meiling & Wang, Yang & Du, Haifeng & Bai, Aruhan, 2024. "Motivating innovation: The impact of prestigious talent funding on junior scientists," Research Policy, Elsevier, vol. 53(9).
    3. Roth, Jonathan & Sant’Anna, Pedro H.C. & Bilinski, Alyssa & Poe, John, 2023. "What’s trending in difference-in-differences? A synthesis of the recent econometrics literature," Journal of Econometrics, Elsevier, vol. 235(2), pages 2218-2244.
    4. Ayoubi, Charles & Pezzoni, Michele & Visentin, Fabiana, 2019. "The important thing is not to win, it is to take part: What if scientists benefit from participating in research grant competitions?," Research Policy, Elsevier, vol. 48(1), pages 84-97.
    5. Cantner, Uwe & Grashof, Nils & Grebel, Thomas & Zhang, Xijie, 2023. "When Excellence is not Excellent: The Impact of the Excellence Initiative on the Relative Productivity of German Universities," MPRA Paper 118139, University Library of Munich, Germany.
    6. Corsini, Alberto & Pezzoni, Michele, 2023. "Does grant funding foster research impact? Evidence from France," Journal of Informetrics, Elsevier, vol. 17(4).
    7. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," Working Papers hal-03912647, HAL.
    8. Katrin Hussinger & João N. Carvalho, 2022. "The long-term effect of research grants on the scientific output of university professors," Industry and Innovation, Taylor & Francis Journals, vol. 29(4), pages 463-487, April.
    9. Perlin, Marcelo & Borenstein, Denis & Imasato, Takeyoshi & Reichert, Marcos, 2024. "The determinants and impact of research grants: The case of Brazilian productivity scholarships," Journal of Informetrics, Elsevier, vol. 18(4).
    10. Koichiro ONISHI & Hideo OWAN, 2020. "Heterogenous Impacts of National Research Grants on Academic Productivity," Discussion papers 20052, Research Institute of Economy, Trade and Industry (RIETI).
    11. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.
    12. Munari, Federico & Toschi, Laura, 2021. "The impact of public funding on science valorisation: an analysis of the ERC Proof-of-Concept Programme," Research Policy, Elsevier, vol. 50(6).
    13. Mark Kattenberg & Bas Scheer & Jurre Thiel, 2023. "Causal forests with fixed effects for treatment effect heterogeneity in difference-in-differences," CPB Discussion Paper 452, CPB Netherlands Bureau for Economic Policy Analysis.
    14. Ejermo, Olof & Sofer, Yotam, 2024. "When colleges graduate: Micro-level effects on publications and scientific organization," Research Policy, Elsevier, vol. 53(6).
    15. Blandinieres, Florence & Pellens, Maikel, 2021. "Scientist's industry engagement and the research agenda: Evidence from Germany," ZEW Discussion Papers 21-001, ZEW - Leibniz Centre for European Economic Research.
    16. Jeffrey M Wooldridge, 2023. "Simple approaches to nonlinear difference-in-differences with panel data," The Econometrics Journal, Royal Economic Society, vol. 26(3), pages 31-66.
    17. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    18. Rachel Heyard & Hanna Hottenrott, 2021. "The value of research funding for knowledge creation and dissemination: A study of SNSF Research Grants," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    19. Adriana Bin & Sergio Salles-Filho & Ana Carolina Spatti & Jesús Pascual Mena-Chalco & Fernando Antonio Basile Colugnati, 2022. "How much does a Ph.D. scholarship program impact an emerging economy research performance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6935-6960, December.
    20. Melnik, Walter & Smyth, Andrew, 2024. "R&D tax credits and innovation," Journal of Public Economics, Elsevier, vol. 236(C).

    More about this item

    Keywords

    Bibliometrics; Research funding; Scientific productivity; Causal inference; Dynamic evaluation;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • O31 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Innovation and Invention: Processes and Incentives
    • O38 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Government Policy

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:130:y:2025:i:3:d:10.1007_s11192-025-05277-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.