IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v51y2022i7s0048733322000427.html
   My bibliography  Save this article

Pork Barrel or Barrel of Gold? Examining the performance implications of earmarking in public R&D grants

Author

Listed:
  • Kok, Holmer
  • Faems, Dries
  • de Faria, Pedro

Abstract

Scholars tend to assume that publicly funded R&D projects, which are competitively selected, outperform projects, which receive funding through a political selection process. In this paper, we empirically explore this assumption, examining the outcomes of 321 R&D projects that were funded by the U.S. Department of Energy's Hydrogen Program. Between 2003 and 2011, projects in this program could not only receive funding by means of a competitive selection process, but also by being earmarked by a U.S. member of Congress. We find that, whereas earmarked projects receive considerably lower peer review evaluation scores than non-earmarked projects, they do not consistently underperform in terms of the productivity, spillovers, and novelty of research- and science-based outcomes. Post-hoc analyses provide indications that this misalignment is driven by the existence of a bias of peer reviewers toward earmarked projects. Jointly, our findings challenge the dominant assumption that competitively selected projects always outperform politically selected ones in the setting of public R&D grants. In this way, we provide academics and policy makers with a richer perspective on the advantages and liabilities of earmarks.

Suggested Citation

  • Kok, Holmer & Faems, Dries & de Faria, Pedro, 2022. "Pork Barrel or Barrel of Gold? Examining the performance implications of earmarking in public R&D grants," Research Policy, Elsevier, vol. 51(7).
  • Handle: RePEc:eee:respol:v:51:y:2022:i:7:s0048733322000427
    DOI: 10.1016/j.respol.2022.104514
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733322000427
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2022.104514?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. A Abigail Payne, 2002. "Do US Congressional earmarks increase research output at universities?," Science and Public Policy, Oxford University Press, vol. 29(5), pages 314-330, October.
    2. Gustavo Manso, 2011. "Motivating Innovation," Journal of Finance, American Finance Association, vol. 66(5), pages 1823-1860, October.
    3. Ina Ganguli, 2017. "Saving Soviet Science: The Impact of Grants When Government R&D Funding Disappears," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 165-201, April.
    4. Knoll, Bodo & Riedel, Nadine & Schwab, Thomas & Todtenhaupt, Maximilian & Voget, Johannes, 2021. "Cross-border effects of R&D tax incentives," Research Policy, Elsevier, vol. 50(9).
    5. Nicholas Bloom & John Van Reenen & Heidi Williams, 2019. "A toolkit of policies to promote innovation," Voprosy Ekonomiki, NP Voprosy Ekonomiki, issue 10.
    6. Ghisetti, Claudia, 2017. "Demand-pull and environmental innovations: Estimating the effects of innovative public procurement," Technological Forecasting and Social Change, Elsevier, vol. 125(C), pages 178-187.
    7. Brach, Ann & wachs, Martin, 2005. "Earmarking in the U.S. Department of Transportation Research Programs," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt9vf8844t, Institute of Transportation Studies, UC Berkeley.
    8. Brach, Ann & Wachs, Martin, 2005. "Earmarking in the US Department of Transportation Research Programs," Transportation Research Part A: Policy and Practice, Elsevier, vol. 39(6), pages 501-521, July.
    9. Lutz Bornmann & Gerlind Wallon & Anna Ledin, 2008. "Does the Committee Peer Review Select the Best Applicants for Funding? An Investigation of the Selection Process for Two European Molecular Biology Organization Programmes," PLOS ONE, Public Library of Science, vol. 3(10), pages 1-11, October.
    10. Czarnitzki, Dirk & Hanel, Petr & Rosa, Julio Miguel, 2011. "Evaluating the impact of R&D tax credits on innovation: A microeconometric study on Canadian firms," Research Policy, Elsevier, vol. 40(2), pages 217-229, March.
    11. Dirk Czarnitzki & Paul Hünermund & Nima Moshgbar, 2018. "Public procurement as policy instrument for innovation," Working Papers of Department of Management, Strategy and Innovation, Leuven 606259, KU Leuven, Faculty of Economics and Business (FEB), Department of Management, Strategy and Innovation, Leuven.
    12. Sciara, Gian-Claudia, 2012. "Financing congressional earmarks: Implications for transport policy and planning," Transportation Research Part A: Policy and Practice, Elsevier, vol. 46(8), pages 1328-1342.
    13. Feldman, Maryann P. & Kelley, Maryellen R., 2006. "The ex ante assessment of knowledge spillovers: Government R&D policy, economic incentives and private firm behavior," Research Policy, Elsevier, vol. 35(10), pages 1509-1521, December.
    14. Gaétan de Rassenfosse & Adam Jaffe & Emilio Raiteri, 2019. "The procurement of innovation by the U.S. government," PLOS ONE, Public Library of Science, vol. 14(8), pages 1-11, August.
    15. Arts, Sam & Hou, Jianan & Gomez, Juan Carlos, 2021. "Natural language processing to identify the creation and impact of new technologies in patent text: Code, data, and new measures," Research Policy, Elsevier, vol. 50(2).
    16. Thomas Heinze, 2008. "How to sponsor ground-breaking research: A comparison of funding schemes," Science and Public Policy, Oxford University Press, vol. 35(5), pages 302-318, June.
    17. Aschhoff, Birgit & Sofka, Wolfgang, 2009. "Innovation on demand--Can public procurement drive market success of innovations?," Research Policy, Elsevier, vol. 38(8), pages 1235-1247, October.
    18. Ginther, Donna K. & Heggeness, Misty L., 2020. "Administrative discretion in scientific funding: Evidence from a prestigious postdoctoral training program✰," Research Policy, Elsevier, vol. 49(4).
    19. Ayoubi, Charles & Pezzoni, Michele & Visentin, Fabiana, 2019. "The important thing is not to win, it is to take part: What if scientists benefit from participating in research grant competitions?," Research Policy, Elsevier, vol. 48(1), pages 84-97.
    20. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    21. Paula Stephan & Reinhilde Veugelers & Jian Wang, 2017. "Reviewers are blinkered by bibliometrics," Nature, Nature, vol. 544(7651), pages 411-412, April.
    22. de Figueiredo, John & Silverman, Brian, 2004. "How Does the Government (Want to) Fund Science? Politics, Lobbying and Academic Earmarks," Working papers 4484-04, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    23. Joshua M. Nicholson & John P. A. Ioannidis, 2012. "Conform and be funded," Nature, Nature, vol. 492(7427), pages 34-36, December.
    24. Sabrina T. Howell, 2017. "Financing Innovation: Evidence from R&D Grants," American Economic Review, American Economic Association, vol. 107(4), pages 1136-1164, April.
    25. Boyle, Melissa A. & Matheson, Victor A., 2009. "Determinants of the distribution of congressional earmarks across states," Economics Letters, Elsevier, vol. 104(2), pages 63-65, August.
    26. Adam B. Jaffe & Gaétan de Rassenfosse, 2017. "Patent citation data in social science research: Overview and best practices," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(6), pages 1360-1374, June.
    27. Goldstein, Anna P. & Kearney, Michael, 2020. "Know when to fold ‘em: An empirical description of risk management in public research funding," Research Policy, Elsevier, vol. 49(1).
    28. John P. A. Ioannidis, 2011. "Fund people not projects," Nature, Nature, vol. 477(7366), pages 529-531, September.
    29. Thijs Bol & Mathijs de Vaan & Arnout van de Rijt, 2018. "The Matthew effect in science funding," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(19), pages 4887-4890, May.
    30. Bianchi, Mattia & Murtinu, Samuele & Scalera, Vittoria G., 2019. "R&D Subsidies as Dual Signals in Technological Collaborations," Research Policy, Elsevier, vol. 48(9), pages 1-1.
    31. Pierre Azoulay & Joshua S. Graff Zivin & Gustavo Manso, 2011. "Incentives and creativity: evidence from the academic life sciences," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 527-554, September.
    32. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2020. "Does the geographic proximity effect on knowledge spillovers vary across research fields?," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 1021-1036, May.
    33. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    34. Lee Fleming, 2001. "Recombinant Uncertainty in Technological Search," Management Science, INFORMS, vol. 47(1), pages 117-132, January.
    35. Hyytinen, Ari & Toivanen, Otto, 2005. "Do financial constraints hold back innovation and growth?: Evidence on the role of public policy," Research Policy, Elsevier, vol. 34(9), pages 1385-1403, November.
    36. Bloom, Nick & Griffith, Rachel & Van Reenen, John, 2002. "Do R&D tax credits work? Evidence from a panel of countries 1979-1997," Journal of Public Economics, Elsevier, vol. 85(1), pages 1-31, July.
    37. Donna K. Ginther & Misty L. Heggeness, 2020. "Administrative Discretion in Scientific Funding: Evidence from a Prestigious Postdoctoral Training Program," NBER Working Papers 26841, National Bureau of Economic Research, Inc.
    38. Christine Wennerås & Agnes Wold, 1997. "Nepotism and sexism in peer-review," Nature, Nature, vol. 387(6631), pages 341-343, May.
    39. Bornmann, Lutz & Mutz, Rüdiger & Daniel, Hans-Dieter, 2007. "Gender differences in grant peer review: A meta-analysis," Journal of Informetrics, Elsevier, vol. 1(3), pages 226-238.
    40. Bonaccorsi, Andrea & Vargas, Juan, 2010. "Proliferation dynamics in new sciences," Research Policy, Elsevier, vol. 39(8), pages 1034-1050, October.
    41. Braun, Dietmar, 1998. "The role of funding agencies in the cognitive development of science," Research Policy, Elsevier, vol. 27(8), pages 807-821, December.
    42. Du, Jingshu & Leten, Bart & Vanhaverbeke, Wim, 2014. "Managing open innovation projects with science-based and market-based partners," Research Policy, Elsevier, vol. 43(5), pages 828-840.
    43. Marc T. Law & Joseph M. Tonon & Gary J. Miller, 2008. "Earmarked: The Political Economy of Agricultural Research Appropriations," Review of Agricultural Economics, Agricultural and Applied Economics Association, vol. 30(2), pages 194-213.
    44. Lanahan, Lauren & Joshi, Amol M. & Johnson, Evan, 2021. "Do public R&D subsidies produce jobs? Evidence from the SBIR/STTR program," Research Policy, Elsevier, vol. 50(7).
    45. Sharaf, Omar Z. & Orhan, Mehmet F., 2014. "An overview of fuel cell technology: Fundamentals and applications," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 810-853.
    46. Carole J. Lee & Cassidy R. Sugimoto & Guo Zhang & Blaise Cronin, 2013. "Bias in peer review," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 64(1), pages 2-17, January.
    47. Goldstein, Anna P. & Narayanamurti, Venkatesh, 2018. "Simultaneous pursuit of discovery and invention in the US Department of Energy," Research Policy, Elsevier, vol. 47(8), pages 1505-1512.
    48. Guerzoni, Marco & Raiteri, Emilio, 2015. "Demand-side vs. supply-side technology policies: Hidden treatment and new empirical evidence on the policy mix," Research Policy, Elsevier, vol. 44(3), pages 726-747.
    49. Bettina Becker, 2015. "Public R&D Policies And Private R&D Investment: A Survey Of The Empirical Evidence," Journal of Economic Surveys, Wiley Blackwell, vol. 29(5), pages 917-942, December.
    50. Choi, Joonhwan & Lee, Jaegul, 2017. "Repairing the R&D market failure: Public R&D subsidy and the composition of private R&D," Research Policy, Elsevier, vol. 46(8), pages 1465-1478.
    51. Peter van den Besselaar & Ulf Sandström & Hélène Schiffbaenker, 2018. "Studying grant decision-making: a linguistic analysis of review reports," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(1), pages 313-329, October.
    52. Danielle Li, 2017. "Expertise versus Bias in Evaluation: Evidence from the NIH," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 60-92, April.
    53. Elhorst, Paul & Faems, Dries, 2021. "Evaluating proposals in innovation contests: Exploring negative scoring spillovers in the absence of a strict evaluation sequence," Research Policy, Elsevier, vol. 50(4).
    54. Wang, Jian & Lee, You-Na & Walsh, John P., 2018. "Funding model and creativity in science: Competitive versus block funding and status contingency effects," Research Policy, Elsevier, vol. 47(6), pages 1070-1083.
    55. Deepak Hegde & Bhaven Sampat, 2015. "Can Private Money Buy Public Science? Disease Group Lobbying and Federal Funding for Biomedical Research," Management Science, INFORMS, vol. 61(10), pages 2281-2298, October.
    56. Martin Reinhart, 2009. "Peer review of grant applications in biology and medicine. Reliability, fairness, and validity," Scientometrics, Springer;Akadémiai Kiadó, vol. 81(3), pages 789-809, December.
    57. de Figueiredo, John M & Silverman, Brian S, 2006. "Academic Earmarks and the Returns to Lobbying," Journal of Law and Economics, University of Chicago Press, vol. 49(2), pages 597-625, October.
    58. Raiteri, Emilio, 2018. "A time to nourish? Evaluating the impact of public procurement on technological generality through patent data," Research Policy, Elsevier, vol. 47(5), pages 936-952.
    59. Corredoira, Rafael A. & Goldfarb, Brent D. & Shi, Yuan, 2018. "Federal funding and the rate and direction of inventive activity," Research Policy, Elsevier, vol. 47(9), pages 1777-1800.
    60. Kevin J. Boudreau & Eva C. Guinan & Karim R. Lakhani & Christoph Riedl, 2016. "Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science," Management Science, INFORMS, vol. 62(10), pages 2765-2783, October.
    61. Melissa Boyle & Victor Matheson, 2008. "Determinants of the Distribution of Congressional Earmarks Across States," Working Papers 0806, College of the Holy Cross, Department of Economics.
    62. Jeffrey Lazarus, 2010. "Giving the People What They Want? The Distribution of Earmarks in the U.S. House of Representatives," American Journal of Political Science, John Wiley & Sons, vol. 54(2), pages 338-353, April.
    63. Michelle Gittelman & Bruce Kogut, 2003. "Does Good Science Lead to Valuable Knowledge? Biotechnology Firms and the Evolutionary Logic of Citation Patterns," Management Science, INFORMS, vol. 49(4), pages 366-382, April.
    64. Erika Check Hayden, 2015. "Racial bias continues to haunt NIH grants," Nature, Nature, vol. 527(7578), pages 286-287, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Charles Ayoubi & Michele Pezzoni & Fabiana Visentin, 2021. "Does It Pay to Do Novel Science? The Selectivity Patterns in Science Funding," Science and Public Policy, Oxford University Press, vol. 48(5), pages 635-648.
    2. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Working Papers 26889, National Bureau of Economic Research, Inc.
    3. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Chapters, in: Innovation and Public Policy, pages 117-150, National Bureau of Economic Research, Inc.
    4. Iossa, Elisabetta & Decarolis, Francesco & de Rassenfosse, Gaétan & Giuffrida, Leonardo Maria & Mollisi, Vincenzo & Raiteri, Emilio & Spagnolo, Giancarlo, 2019. "Buyers' Role in Innovation Procurement," CEPR Discussion Papers 13777, C.E.P.R. Discussion Papers.
    5. Blandinieres, Florence & Pellens, Maikel, 2021. "Scientist's industry engagement and the research agenda: Evidence from Germany," ZEW Discussion Papers 21-001, ZEW - Leibniz Centre for European Economic Research.
    6. Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019. "Evaluation in research funding agencies: Are structurally diverse teams biased against?," Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
    7. Lawson, Cornelia & Salter, Ammon, 2023. "Exploring the effect of overlapping institutional applications on panel decision-making," Research Policy, Elsevier, vol. 52(9).
    8. Serenella Caravella & Francesco Crespi, 2021. "The role of public procurement as innovation lever: evidence from Italian manufacturing firms," Economics of Innovation and New Technology, Taylor & Francis Journals, vol. 30(7), pages 663-684, October.
    9. Francesco Decarolis & Gaétan de Rassenfosse & Leonardo M. Giuffrida & Elisabetta Iossa & Vincenzo Mollisi & Emilio Raiteri & Giancarlo Spagnolo, 2021. "Buyers' role in innovation procurement: Evidence from US military R&D contracts," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 30(4), pages 697-720, November.
    10. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    11. Dorothea Schäfer & Andreas Stephan & Sören Fuhrmeister, 2022. "The Impact of Public Procurement on Financial Barriers to Green Innovation: Evidence from European Community Innovation Survey," Discussion Papers of DIW Berlin 2014, DIW Berlin, German Institute for Economic Research.
    12. Jürgen Janger & Nicole Schmidt & Anna Strauss, 2019. "International Differences in Basic Research Grant Funding. A Systematic Comparison," WIFO Studies, WIFO, number 61664, February.
    13. Chen Weijun, 2022. "The Impact of Government Support and Technological Innovation on Enterprise Performance: A Case Study of Guangdong Hi- tech Enterprises," International Journal of Science and Business, IJSAB International, vol. 14(1), pages 196-231.
    14. Ginther, Donna K. & Heggeness, Misty L., 2020. "Administrative discretion in scientific funding: Evidence from a prestigious postdoctoral training program✰," Research Policy, Elsevier, vol. 49(4).
    15. Gianluca Pallante & Emanuele Russo & Andrea Roventini, 2020. "Does mission-oriented funding stimulate private R&D? Evidence from military R&D for US states," Working Papers hal-04097530, HAL.
    16. Conor O’Kane & Jing A. Zhang & Jarrod Haar & James A. Cunningham, 2023. "How scientists interpret and address funding criteria: value creation and undesirable side effects," Small Business Economics, Springer, vol. 61(2), pages 799-826, August.
    17. Albert Banal-Estañol & Inés Macho-Stadler & David Pérez-Castillo, 2019. "Funding academic research: grant application, partnership, award, and output," Economics Working Papers 1658, Department of Economics and Business, Universitat Pompeu Fabra.
    18. Dai, Xiaoyong & Li, Yanchao & Chen, Kaihua, 2021. "Direct demand-pull and indirect certification effects of public procurement for innovation," Technovation, Elsevier, vol. 101(C).
    19. Howell, Sabrina T. & Rathje, Jason & Van Reenen, John & Wong, Jun, 2021. "Opening up Military Innovation: Causal Effects of 'Bottom-up' Reforms to U.S. Defense Research," IZA Discussion Papers 14297, Institute of Labor Economics (IZA).
    20. Gianluca Pallante & Emanuele Russo & Andrea Roventini, 2020. "Does public R&D funding crowd-in private R&D investment? Evidence from military R&D expenditures for US states," LEM Papers Series 2020/32, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:51:y:2022:i:7:s0048733322000427. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.