IDEAS home Printed from https://ideas.repec.org/a/plo/pbio00/3000065.html
   My bibliography  Save this article

Contest models highlight inherent inefficiencies of scientific funding competitions

Author

Listed:
  • Kevin Gross
  • Carl T Bergstrom

Abstract

Scientific research funding is allocated largely through a system of soliciting and ranking competitive grant proposals. In these competitions, the proposals themselves are not the deliverables that the funder seeks, but instead are used by the funder to screen for the most promising research ideas. Consequently, some of the funding program's impact on science is squandered because applying researchers must spend time writing proposals instead of doing science. To what extent does the community's aggregate investment in proposal preparation negate the scientific impact of the funding program? Are there alternative mechanisms for awarding funds that advance science more efficiently? We use the economic theory of contests to analyze how efficiently grant proposal competitions advance science, and compare them with recently proposed, partially randomized alternatives such as lotteries. We find that the effort researchers waste in writing proposals may be comparable to the total scientific value of the research that the funding supports, especially when only a few proposals can be funded. Moreover, when professional pressures motivate investigators to seek funding for reasons that extend beyond the value of the proposed science (e.g., promotion, prestige), the entire program can actually hamper scientific progress when the number of awards is small. We suggest that lost efficiency may be restored either by partial lotteries for funding or by funding researchers based on past scientific success instead of proposals for future work.Scientists waste substantial time writing grant proposals, potentially squandering much of the scientific value of funding programs. This Meta-Research Article shows that, unfortunately, grant-proposal competitions are inevitably inefficient when the number of awards is small, but efficiency can be restored by awarding funds through a modified lottery, or by weighting past research success more heavily in funding decisions.Author summary: The grant proposal system compels researchers to devote substantial time to writing proposals that could have instead been used to do science. Here, we use the economic theory of contests to show that as fewer grants are funded, the value of the science that researchers forgo while preparing proposals can approach or exceed the value of the science that the funding program supports. As a result, much of the scientific impact of the funding program is squandered. Unfortunately, increased waste and reduced efficiency is inevitable in a grant proposal competition when the number of awards is small. How can scarce funds be allocated efficiently, then? As one alternative, we show that a partial lottery that selects proposals for funding randomly from among those that pass a qualifying standard can restore lost efficiency by reducing investigators' incentives to invest heavily in preparing proposals. Lotteries could also improve efficiency by compelling administrators to de-emphasize grant success as a primary measure of professional achievement. If lotteries are politically untenable, another remedy would be to fund researchers based on their previous research successes, although in such a way that avoids establishing barriers to entry for junior scientists or scientists from historically underrepresented demographic groups.

Suggested Citation

  • Kevin Gross & Carl T Bergstrom, 2019. "Contest models highlight inherent inefficiencies of scientific funding competitions," PLOS Biology, Public Library of Science, vol. 17(1), pages 1-15, January.
  • Handle: RePEc:plo:pbio00:3000065
    DOI: 10.1371/journal.pbio.3000065
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3000065
    Download Restriction: no

    File URL: https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.3000065&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pbio.3000065?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Benny Moldovanu & Aner Sela, 2001. "The Optimal Allocation of Prizes in Contests," American Economic Review, American Economic Association, vol. 91(3), pages 542-558, June.
    2. Elise S Brezis, 2007. "Focal randomisation: An optimal mechanism for the evaluation of R&D projects," Science and Public Policy, Oxford University Press, vol. 34(10), pages 691-698, December.
    3. Heidrun C. Hoppe & Benny Moldovanu & Aner Sela, 2009. "The Theory of Assortative Matching Based on Costly Signals," Review of Economic Studies, Oxford University Press, vol. 76(1), pages 253-281.
    4. John P. A. Ioannidis, 2011. "Fund people not projects," Nature, Nature, vol. 477(7366), pages 529-531, September.
    5. Elizabeth L. Pier & Markus Brauer & Amarette Filut & Anna Kaatz & Joshua Raclaw & Mitchell J. Nathan & Cecilia E. Ford & Molly Carnes, 2018. "Low agreement among reviewers evaluating the same NIH grant applications," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(12), pages 2952-2957, March.
    6. Link, Albert N. & Swann, Christopher A. & Bozeman, Barry, 2008. "A time allocation study of university faculty," Economics of Education Review, Elsevier, vol. 27(4), pages 363-374, August.
    7. Peter A Lawrence, 2009. "Real Lives and White Lies in the Funding of Scientific Research," PLOS Biology, Public Library of Science, vol. 7(9), pages 1-4, September.
    8. Krist Vaesen & Joel Katzav, 2017. "How much would each researcher receive if competitive government research funding were distributed equally among researchers?," PLOS ONE, Public Library of Science, vol. 12(9), pages 1-11, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. van Dalen, Hendrik Peter, 2020. "How the Publish-or-Perish Principle Divides a Science : The Case of Academic Economists," Discussion Paper 2020-020, Tilburg University, Center for Economic Research.
    2. Kyle R. Myers, 2022. "Some Tradeoffs of Competition in Grant Contests," Papers 2207.02379, arXiv.org, revised Mar 2024.
    3. Elise S. Brezis & Aliaksandr Birukou, 2020. "Arbitrariness in the peer review process," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 393-411, April.
    4. Oliver Braganza, 2020. "A simple model suggesting economically rational sample-size choice drives irreproducibility," PLOS ONE, Public Library of Science, vol. 15(3), pages 1-19, March.
    5. Leonid Tiokhin & Minhua Yan & Thomas J. H. Morgan, 2021. "Competition for priority harms the reliability of science, but reforms can help," Nature Human Behaviour, Nature, vol. 5(7), pages 857-867, July.
    6. Elena A. Erosheva & Patrícia Martinková & Carole J. Lee, 2021. "When zero may not be zero: A cautionary note on the use of inter‐rater reliability in evaluating grant peer review," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 184(3), pages 904-919, July.
    7. Chiara Franzoni & Paula Stephan & Reinhilde Veugelers, 2022. "Funding Risky Research," Entrepreneurship and Innovation Policy and the Economy, University of Chicago Press, vol. 1(1), pages 103-133.
    8. Ottaviani, Marco, 2020. "Grantmaking," CEPR Discussion Papers 15389, C.E.P.R. Discussion Papers.
      • Marco Ottaviani, 2020. "Grantmaking," Working Papers 672, IGIER (Innocenzo Gasparini Institute for Economic Research), Bocconi University.
    9. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Working Papers 26889, National Bureau of Economic Research, Inc.
    10. Balietti, Stefano & Riedl, Christoph, 2021. "Incentives, competition, and inequality in markets for creative production," Research Policy, Elsevier, vol. 50(4).
    11. Gregoire Mariethoz & Frédéric Herman & Amelie Dreiss, 2021. "The imaginary carrot: no correlation between raising funds and research productivity in geosciences," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(3), pages 2401-2407, March.
    12. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Chapters, in: Innovation and Public Policy, pages 117-150, National Bureau of Economic Research, Inc.
    13. Tanel Hirv, 2022. "The interplay of the size of the research system, ways of collaboration, level, and method of funding in determining bibliometric outputs," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(3), pages 1295-1316, March.
    14. Kyle R. Myers & Wei Yang Tham & Jerry Thursby & Marie Thursby & Nina Cohodes & Karim Lakhani & Rachel Mural & Yilun Xu, 2023. "New Facts and Data about Professors and their Research," Papers 2312.01442, arXiv.org.
    15. Ellgen, Clifford & Kang, Dominique, 2021. "Research equity: Incentivizing high-risk basic research with market mechanisms," SocArXiv cvngq, Center for Open Science.
    16. Axel Philipps, 2022. "Research funding randomly allocated? A survey of scientists’ views on peer review and lottery," Science and Public Policy, Oxford University Press, vol. 49(3), pages 365-377.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kyle R. Myers, 2022. "Some Tradeoffs of Competition in Grant Contests," Papers 2207.02379, arXiv.org, revised Mar 2024.
    2. Salgado Alfredo, 2018. "Incomplete Information and Costly Signaling in College Admissions," Working Papers 2018-23, Banco de México.
    3. Ed Hopkins & Tatiana Kornienko, 2007. "Cross and Double Cross: Comparative Statics in First Price Auctions," Levine's Bibliography 321307000000000831, UCLA Department of Economics.
    4. Elias Bouacida & Renaud Foucart, 2022. "Rituals of Reason," Working Papers 344119591, Lancaster University Management School, Economics Department.
    5. Chakravarty, Surajeet & Kaplan, Todd R., 2013. "Optimal allocation without transfer payments," Games and Economic Behavior, Elsevier, vol. 77(1), pages 1-20.
    6. Minchuk, Yizhaq & Sela, Aner, 2014. "All-pay auctions with certain and uncertain prizes," Games and Economic Behavior, Elsevier, vol. 88(C), pages 130-134.
    7. Charles Ayoubi & Michele Pezzoni & Fabiana Visentin, 2021. "Does It Pay to Do Novel Science? The Selectivity Patterns in Science Funding," Science and Public Policy, Oxford University Press, vol. 48(5), pages 635-648.
    8. Aner Sela, 2023. "All-pay matching contests," International Journal of Game Theory, Springer;Game Theory Society, vol. 52(2), pages 587-606, June.
    9. Elias Bouacida & Renaud Foucart, 2020. "The acceptability of lotteries in allocation problems," Working Papers 301646245, Lancaster University Management School, Economics Department.
    10. Elise S. Brezis & Aliaksandr Birukou, 2020. "Arbitrariness in the peer review process," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 393-411, April.
    11. Chen Cohen & Ishay Rabi & Aner Sela, 2020. "Assortative Matching Contests," Working Papers 2004, Ben-Gurion University of the Negev, Department of Economics.
    12. Axel Philipps, 2022. "Research funding randomly allocated? A survey of scientists’ views on peer review and lottery," Science and Public Policy, Oxford University Press, vol. 49(3), pages 365-377.
    13. Dizdar, Deniz & Moldovanu, Benny & Szech, Nora, 2019. "The feedback effect in two-sided markets with bilateral investments," Journal of Economic Theory, Elsevier, vol. 182(C), pages 106-142.
    14. St-Pierre, Marc, 2016. "The role of inequality on effort in tournaments," Mathematical Social Sciences, Elsevier, vol. 81(C), pages 38-52.
    15. Chen Cohen & Ishay Rabi & Aner Sela, 2022. "Assortative Matching by Lottery Contests," Games, MDPI, vol. 13(5), pages 1-20, September.
    16. Peters, Michael, 2006. "Truncated Hedonic Equilibrium," Microeconomics.ca working papers peters-06-04-11-02-42-39, Vancouver School of Economics, revised 03 Mar 2009.
    17. Hinnosaar, Toomas, 2024. "Optimal sequential contests," Theoretical Economics, Econometric Society, vol. 19(1), January.
    18. Emmanuel Dechenaux & Dan Kovenock & Roman Sheremeta, 2015. "A survey of experimental research on contests, all-pay auctions and tournaments," Experimental Economics, Springer;Economic Science Association, vol. 18(4), pages 609-669, December.
    19. Andonie, Costel & Kuzmics, Christoph & Rogers, Brian W., 2019. "Efficiency-based measures of inequality," Journal of Mathematical Economics, Elsevier, vol. 85(C), pages 60-69.
    20. Xiao, Jun, 2018. "Equilibrium analysis of the all-pay contest with two nonidentical prizes: Complete results," Journal of Mathematical Economics, Elsevier, vol. 74(C), pages 21-34.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pbio00:3000065. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosbiology (email available below). General contact details of provider: https://journals.plos.org/plosbiology/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.