IDEAS home Printed from https://ideas.repec.org/p/iza/izadps/dp16108.html
   My bibliography  Save this paper

The Long-Term Causal Effects of Winning an ERC Grant

Author

Listed:
  • Ghirelli, Corinna

    (Bank of Spain)

  • Havari, Enkelejda

    (IÉSEG School of Management)

  • Meroni, Elena Claudia

    (European Commission, Joint Research Centre)

  • Verzillo, Stefano

    (European Commission Joint Research Centre (JRC))

Abstract

This paper investigates the long-term causal effects of receiving an ERC grant on researcher productivity, excellence and the ability to obtain additional research funding up to nine years after grant assignment. We use data on the universe of ERC applicants between 2007-2013 and information on their complete publication histories from the Scopus database. For identification, we first exploit the assignment rule based on rankings, comparing the outcomes of the winning and non-winning applicants in a regression discontinuity design (RDD). We fail to find any statistically significant effect on research productivity and quality, which suggests that receiving an ERC grant does not make a difference in terms of scientific impact for researchers with a ranking position close enough to the threshold. Since RDDs help identify a local effect, we also conduct a difference-in-differences (DID) analysis using the time series of bibliometric indicators available, which allows us to estimate the effect on a wider population of winning and non-winning applicants. Differently from the RDD results, DID estimates show that obtaining an ERC grant leads to positive long-term effects on scientific productivity, impact and the capacity to attract other EU funds in the fields of Chemistry, Universe and Earth Sciences, Institutions and Behaviours, Human Mind Studies and Medicine. Further analysis of heterogeneous effects leads us conclude that the positive results obtained with DID seem to be driven by the top-ranked applicants in these fields.

Suggested Citation

  • Ghirelli, Corinna & Havari, Enkelejda & Meroni, Elena Claudia & Verzillo, Stefano, 2023. "The Long-Term Causal Effects of Winning an ERC Grant," IZA Discussion Papers 16108, Institute of Labor Economics (IZA).
    • Handle: RePEc:iza:izadps:dp16108
    as

    Download full text from publisher

    File URL: https://docs.iza.org/dp16108.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Ina Ganguli, 2017. "Saving Soviet Science: The Impact of Grants When Government R&D Funding Disappears," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 165-201, April.
    2. Benavente, José Miguel & Crespi, Gustavo & Figal Garone, Lucas & Maffioli, Alessandro, 2012. "The impact of national research funds: A regression discontinuity approach to the Chilean FONDECYT," Research Policy, Elsevier, vol. 41(8), pages 1461-1475.
    3. Rachel Heyard & Hanna Hottenrott, 2020. "The Impact of Research Funding on Knowledge Creation and Dissemination: A study of SNSF Research Grants," Papers 2011.11274, arXiv.org, revised Aug 2021.
    4. Raminta Pranckutė, 2021. "Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World," Publications, MDPI, vol. 9(1), pages 1-59, March.
    5. Sebastian Calonico & Matias D. Cattaneo & Rocio Titiunik, 2014. "Robust Nonparametric Confidence Intervals for Regression‐Discontinuity Designs," Econometrica, Econometric Society, vol. 82, pages 2295-2326, November.
    6. Katrin Hussinger & João N. Carvalho, 2022. "The long-term effect of research grants on the scientific output of university professors," Industry and Innovation, Taylor & Francis Journals, vol. 29(4), pages 463-487, April.
    7. Joshua L Rosenbloom & Donna K Ginther & Ted Juhl & Joseph A Heppert, 2015. "The Effects of Research & Development Funding on Scientific Productivity: Academic Chemistry, 1990-2009," PLOS ONE, Public Library of Science, vol. 10(9), pages 1-23, September.
    8. Weishu Liu, 2020. "Accuracy of funding information in Scopus: a comparative case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 124(1), pages 803-811, July.
    9. David Popp, 2016. "Economic analysis of scientific publications and implications for energy research and development," Nature Energy, Nature, vol. 1(4), pages 1-8, April.
    10. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    11. Charles Ayoubi & Michele Pezzoni & Fabiana Visentin, 2021. "Does It Pay to Do Novel Science? The Selectivity Patterns in Science Funding," Science and Public Policy, Oxford University Press, vol. 48(5), pages 635-648.
    12. Sant’Anna, Pedro H.C. & Zhao, Jun, 2020. "Doubly robust difference-in-differences estimators," Journal of Econometrics, Elsevier, vol. 219(1), pages 101-122.
    13. Sebastian Calonico & Matias D Cattaneo & Max H Farrell, 2020. "Optimal bandwidth choice for robust bias-corrected inference in regression discontinuity designs [Econometric methods for program evaluation]," The Econometrics Journal, Royal Economic Society, vol. 23(2), pages 192-210.
    14. Ashish Arora & Alfonso Gambardella, 2010. "The Impact of NSF Support for Basic Research in Economics," NBER Chapters, in: Contributions in Memory of Zvi Griliches, pages 91-115, National Bureau of Economic Research, Inc.
    15. Liv Langfeldt & Carter Walter Bloch & Gunnar Sivertsen, 2015. "Options and limitations in measuring the impact of research grants—evidence from Denmark and Norway," Research Evaluation, Oxford University Press, vol. 24(3), pages 256-270.
    16. Dmitry Arkhangelsky & Guido W Imbens, 2022. "Doubly robust identification for causal panel data models [Sufficient statistics for unobserved heterogeneity in structural dynamic logit models]," The Econometrics Journal, Royal Economic Society, vol. 25(3), pages 649-674.
    17. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    18. Callaway, Brantly & Sant’Anna, Pedro H.C., 2021. "Difference-in-Differences with multiple time periods," Journal of Econometrics, Elsevier, vol. 225(2), pages 200-230.
    19. Matias D. Cattaneo & Michael Jansson & Xinwei Ma, 2018. "Manipulation testing based on density discontinuity," Stata Journal, StataCorp LP, vol. 18(1), pages 234-261, March.
    20. Dmitry Arkhangelsky & Guido W. Imbens, 2019. "Doubly Robust Identification for Causal Panel Data Models," Papers 1909.09412, arXiv.org, revised Feb 2022.
    21. Margherita Fort & Andrea Ichino & Enrico Rettore & Giulio Zanella, 2022. "Multicutoff RD designs with observations located at each cutoff: problems and solutions," FBK-IRVAPP Working Papers 2022-01, Research Institute for the Evaluation of Public Policies (IRVAPP), Bruno Kessler Foundation.
    22. Daniel Chudnovsky & Andrés López & Martín A. Rossi & Diego Ubfal, 2008. "Money for Science? The Impact of Research Grants on Academic Output," Fiscal Studies, Institute for Fiscal Studies, vol. 29(1), pages 75-87, March.
    23. Reinhilde Veugelers & Jian Wang & Paula Stephan, 2022. "Do Funding Agencies Select and Enable Risky Research: Evidence from ERC Using Novelty as a Proxy of Risk Taking," NBER Working Papers 30320, National Bureau of Economic Research, Inc.
    24. Sun, Liyang & Abraham, Sarah, 2021. "Estimating dynamic treatment effects in event studies with heterogeneous treatment effects," Journal of Econometrics, Elsevier, vol. 225(2), pages 175-199.
    25. Matias D. Cattaneo & Nicolas Idrobo & Rocio Titiunik, 2019. "A Practical Introduction to Regression Discontinuity Designs: Foundations," Papers 1911.09511, arXiv.org.
    26. Yang Wang & Benjamin F. Jones & Dashun Wang, 2019. "Early-career setback and future career impact," Nature Communications, Nature, vol. 10(1), pages 1-10, December.
    27. repec:adr:anecst:y:2005:i:79-80:p:04 is not listed on IDEAS
    28. Alexander Whalley & Justin Hicks, 2014. "Spending Wisely? How Resources Affect Knowledge Production In Universities," Economic Inquiry, Western Economic Association International, vol. 52(1), pages 35-55, January.
    29. Rachel Heyard & Hanna Hottenrott, 2021. "The value of research funding for knowledge creation and dissemination: A study of SNSF Research Grants," Palgrave Communications, Palgrave Macmillan, vol. 8(1), pages 1-16, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Marco Cozzi, 2020. "Public Funding of Research and Grant Proposals in the Social Sciences: Empirical Evidence from Canada," Department Discussion Papers 1809, Department of Economics, University of Victoria.
    2. Katrin Hussinger & João N. Carvalho, 2022. "The long-term effect of research grants on the scientific output of university professors," Industry and Innovation, Taylor & Francis Journals, vol. 29(4), pages 463-487, April.
    3. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    4. Dmitry Arkhangelsky & Guido Imbens, 2023. "Causal Models for Longitudinal and Panel Data: A Survey," Papers 2311.15458, arXiv.org, revised Mar 2024.
    5. Mohamed Abouaziza, 2022. "Farmer constraints and relational contracts: evidence from agricultural value chains in East Africa," Economics PhD Theses 0122, Department of Economics, University of Sussex Business School.
    6. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," Working Papers hal-03912647, HAL.
    7. ONISHI Koichiro & OWAN Hideo, 2020. "Heterogenous Impacts of National Research Grants on Academic Productivity," Discussion papers 20052, Research Institute of Economy, Trade and Industry (RIETI).
    8. Alberto Corsini & Michele Pezzoni, 2022. "Does grant funding foster research impact? Evidence from France," SciencePo Working papers Main hal-03912647, HAL.
    9. Adriana Bin & Sergio Salles-Filho & Ana Carolina Spatti & Jesús Pascual Mena-Chalco & Fernando Antonio Basile Colugnati, 2022. "How much does a Ph.D. scholarship program impact an emerging economy research performance?," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(12), pages 6935-6960, December.
    10. Morten Henningsen & Torbjørn Hægeland & Jarle Møen, 2015. "Estimating the additionality of R&D subsidies using proposal evaluation data to control for research intentions," The Journal of Technology Transfer, Springer, vol. 40(2), pages 227-251, April.
    11. Park, Hyunwoo & Lee, Jeongsik (Jay) & Kim, Byung-Cheol, 2015. "Project selection in NIH: A natural experiment from ARRA," Research Policy, Elsevier, vol. 44(6), pages 1145-1159.
    12. Bhalotra, Sonia R. & Britto, Diogo & Pinotti, Paolo & Sampaio, Breno, 2021. "Job Displacement, Unemployment Benefits and Domestic Violence," IZA Discussion Papers 14543, Institute of Labor Economics (IZA).
    13. Hottenrott, Hanna & Lawson, Cornelia, 2013. "Fishing for Complementarities: Competitive Research Funding and Research Productivity," Department of Economics and Statistics Cognetti de Martiis LEI & BRICK - Laboratory of Economics of Innovation "Franco Momigliano", Bureau of Research in Innovation, Complexity and Knowledge, Collegio 201318, University of Turin.
    14. Mauricio Villamizar‐Villegas & Freddy A. Pinzon‐Puerto & Maria Alejandra Ruiz‐Sanchez, 2022. "A comprehensive history of regression discontinuity designs: An empirical survey of the last 60 years," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1130-1178, September.
    15. Wilmar Cabrera & Santiago Gamba & Camilo Gómez & Mauricio Villamizar-Villegas, 2022. "Examining Macroprudential Policy through a Microprudential Lens," Borradores de Economia 1212, Banco de la Republica de Colombia.
    16. Anckaert, Paul-Emmanuel & Cassiman, David & Cassiman, Bruno, 2020. "Fostering practice-oriented and use-inspired science in biomedical research," Research Policy, Elsevier, vol. 49(2).
    17. Marielle Non & Jeroen van Honk & Vince van Houten & Inge van der Weijden & Thed van Leeuwen, 2022. "Getting off to a flying start? The effects of an early-career international mobility grant on scientific performance," CPB Discussion Paper 443, CPB Netherlands Bureau for Economic Policy Analysis.
    18. Ayoubi, Charles & Pezzoni, Michele & Visentin, Fabiana, 2019. "The important thing is not to win, it is to take part: What if scientists benefit from participating in research grant competitions?," Research Policy, Elsevier, vol. 48(1), pages 84-97.
    19. Xingchi Shen & Yueming Lucy Qiu & Pengfei Liu & Anand Patwardhan, 2022. "The Effect of Rebate and Loan Incentives on Residential Heat Pump Adoption: Evidence from North Carolina," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 82(3), pages 741-789, July.
    20. Arisi, Diego & Cortés, Alix & Delic, Diego & Rossi, Martín, 2022. "Knowledge for Results and the Efficiency of Public Agencies in Colombia," IDB Publications (Working Papers) 12007, Inter-American Development Bank.

    More about this item

    Keywords

    research grants; ERC; regression discontinuity design; difference in differences; EU funds; policy evaluation;
    All these keywords.

    JEL classification:

    • I23 - Health, Education, and Welfare - - Education - - - Higher Education; Research Institutions
    • D04 - Microeconomics - - General - - - Microeconomic Policy: Formulation; Implementation; Evaluation
    • O3 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:iza:izadps:dp16108. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Holger Hinte (email available below). General contact details of provider: https://edirc.repec.org/data/izaaade.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.