IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v52y2023i9s004873332300152x.html
   My bibliography  Save this article

Exploring the effect of overlapping institutional applications on panel decision-making

Author

Listed:
  • Lawson, Cornelia
  • Salter, Ammon

Abstract

The assessing of a pool of competing projects is a challenging task for scientific panels at funding agencies. Using large-scale and rich data from a broad set of panels from the UK's largest research council, we explore whether scientific panels treat overlapping applications from the same institution in a selection round differently. Building on previous research that suggested that panels may favour institutional diversity in funding outcomes, we find that applications at the margin of the funding decision are less likely to be funded when an application from the same institution is also funded. However, we find little evidence of welfare losses associated with this outcome. The implications of these findings for understanding the role of panels in shaping of scientific funding are also examined.

Suggested Citation

  • Lawson, Cornelia & Salter, Ammon, 2023. "Exploring the effect of overlapping institutional applications on panel decision-making," Research Policy, Elsevier, vol. 52(9).
    • Handle: RePEc:eee:respol:v:52:y:2023:i:9:s004873332300152x
    DOI: 10.1016/j.respol.2023.104868
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S004873332300152X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.respol.2023.104868?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Viner, Neil & Powell, Philip & Green, Rod, 2004. "Institutionalized biases in the award of research grants: a preliminary analysis revisiting the principle of accumulative advantage," Research Policy, Elsevier, vol. 33(3), pages 443-454, April.
    2. Meike Olbrecht & Lutz Bornmann, 2010. "Panel peer review of grant applications: what do we know from research in social psychology on judgment and decision-making in groups?," Research Evaluation, Oxford University Press, vol. 19(4), pages 293-304, October.
    3. Matthew Lee & Laura Huang, 2018. "Gender Bias, Social Impact Framing, and Evaluation of Entrepreneurial Ventures," Organization Science, INFORMS, vol. 29(1), pages 1-16, February.
    4. Christos Kolympiris & Sebastian Hoenen & Peter G. Klein, 2019. "Learning by Seconding: Evidence from National Science Foundation Rotators," Organization Science, INFORMS, vol. 30(3), pages 528-551, May.
    5. Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019. "Evaluation in research funding agencies: Are structurally diverse teams biased against?," Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
    6. Ayoubi, Charles & Pezzoni, Michele & Visentin, Fabiana, 2019. "The important thing is not to win, it is to take part: What if scientists benefit from participating in research grant competitions?," Research Policy, Elsevier, vol. 48(1), pages 84-97.
    7. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of research grant funding on scientific productivity," Journal of Public Economics, Elsevier, vol. 95(9), pages 1168-1177.
    8. Charles Ayoubi & Michele Pezzoni & Fabiana Visentin, 2021. "Does It Pay to Do Novel Science? The Selectivity Patterns in Science Funding," Science and Public Policy, Oxford University Press, vol. 48(5), pages 635-648.
    9. Jacob, Brian A. & Lefgren, Lars, 2011. "The impact of NIH postdoctoral training grants on scientific productivity," Research Policy, Elsevier, vol. 40(6), pages 864-874, July.
    10. van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
    11. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    12. Rachel Heyard & Manuela Ott & Georgia Salanti & Matthias Egger, 2022. "Rethinking the Funding Line at the Swiss National Science Foundation: Bayesian Ranking and Lottery," Statistics and Public Policy, Taylor & Francis Journals, vol. 9(1), pages 110-121, December.
    13. Thijs Bol & Mathijs de Vaan & Arnout van de Rijt, 2018. "The Matthew effect in science funding," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 115(19), pages 4887-4890, May.
    14. Ashish Arora & Paul David & Alfonso Gambardella, 1998. "Reputation and Competence in Publicly Funded Science: Estimating the Effects on Research Group Productivity," Annals of Economics and Statistics, GENES, issue 49-50, pages 163-198.
    15. Chiara Franzoni & Paula Stephan & Reinhilde Veugelers, 2022. "Funding Risky Research," Entrepreneurship and Innovation Policy and the Economy, University of Chicago Press, vol. 1(1), pages 103-133.
    16. Pleun van Arensbergen & Inge van der Weijden & Peter van den Besselaar, 2014. "The selection of talent as a group process. A literature review on the social dynamics of decision making in grant panels," Research Evaluation, Oxford University Press, vol. 23(4), pages 298-311.
    17. Power, Michael, 2015. "How accounting begins: Object formation and the accretion of infrastructure," Accounting, Organizations and Society, Elsevier, vol. 47(C), pages 43-55.
    18. repec:adr:anecst:y:1998:i:49-50:p:06 is not listed on IDEAS
    19. Bozeman, Barry & Gaughan, Monica, 2007. "Impacts of grants and contracts on academic researchers' interactions with industry," Research Policy, Elsevier, vol. 36(5), pages 694-707, June.
    20. Donna K. Ginther & Misty L. Heggeness, 2020. "Administrative Discretion in Scientific Funding: Evidence from a Prestigious Postdoctoral Training Program," NBER Working Papers 26841, National Bureau of Economic Research, Inc.
    21. David Adam, 2019. "Science funders gamble on grant lotteries," Nature, Nature, vol. 575(7784), pages 574-575, November.
    22. Bol, Thijs & de Vaan, Mathijs & van de Rijt, Arnout, 2022. "Gender-equal funding rates conceal unequal evaluations," Research Policy, Elsevier, vol. 51(1).
    23. Lindell Bromham & Russell Dinnage & Xia Hua, 2016. "Interdisciplinary research has consistently lower funding success," Nature, Nature, vol. 534(7609), pages 684-687, June.
    24. Danielle Li, 2017. "Expertise versus Bias in Evaluation: Evidence from the NIH," American Economic Journal: Applied Economics, American Economic Association, vol. 9(2), pages 60-92, April.
    25. Boyack, Kevin W. & Patek, Michael & Ungar, Lyle H. & Yoon, Patrick & Klavans, Richard, 2014. "Classification of individual articles from all of science by research level," Journal of Informetrics, Elsevier, vol. 8(1), pages 1-12.
    26. Robert M. Feinberg & Gregory N. Price, 2004. "The Funding of Economics Research: Does Social Capital Matter for Success at the National Science Foundation?," The Review of Economics and Statistics, MIT Press, vol. 86(1), pages 245-252, February.
    27. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2018. "The effects of gender, age and academic rank on research diversification," Scientometrics, Springer;Akadémiai Kiadó, vol. 114(2), pages 373-387, February.
    28. Kevin J. Boudreau & Eva C. Guinan & Karim R. Lakhani & Christoph Riedl, 2016. "Looking Across and Looking Beyond the Knowledge Frontier: Intellectual Distance, Novelty, and Resource Allocation in Science," Management Science, INFORMS, vol. 62(10), pages 2765-2783, October.
    29. Wu, Yonghong, 2010. "Tackling undue concentration of federal research funding: An empirical assessment on NSF's Experimental Program to Stimulate Competitive Research (EPSCoR)," Research Policy, Elsevier, vol. 39(6), pages 835-841, July.
    30. Francis Narin & Gabriel Pinski & Helen Hofer Gee, 1976. "Structure of the Biomedical Literature," Journal of the American Society for Information Science, Association for Information Science & Technology, vol. 27(1), pages 25-45, January.
    31. Julian Kolev & Yuly Fuentes-Medel & Fiona Murray, 2019. "Is Blinded Review Enough? How Gendered Outcomes Arise Even Under Anonymous Evaluation," NBER Working Papers 25759, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kok, Holmer & Faems, Dries & de Faria, Pedro, 2022. "Pork Barrel or Barrel of Gold? Examining the performance implications of earmarking in public R&D grants," Research Policy, Elsevier, vol. 51(7).
    2. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    3. Albert Banal-Estañol & Qianshuo Liu & Inés Macho-Stadler & David Pérez-Castrillo, 2021. "Similar-to-me Effects in the Grant Application Process: Applicants, Panelists, and the Likelihood of Obtaining Funds," Working Papers 1289, Barcelona School of Economics.
    4. Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019. "Evaluation in research funding agencies: Are structurally diverse teams biased against?," Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
    5. Ginther, Donna K. & Heggeness, Misty L., 2020. "Administrative discretion in scientific funding: Evidence from a prestigious postdoctoral training program✰," Research Policy, Elsevier, vol. 49(4).
    6. Albert Banal-Estañol & Inés Macho-Stadler & David Pérez-Castillo, 2019. "Funding academic research: grant application, partnership, award, and output," Economics Working Papers 1658, Department of Economics and Business, Universitat Pompeu Fabra.
    7. Stefano Bianchini & Patrick Llerena & Sıla Öcalan-Özel & Emre Özel, 2022. "Gender diversity of research consortia contributes to funding decisions in a multi-stage grant peer-review process," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-10, December.
    8. Belén Álvarez-Bornstein & Adrián A. Díaz-Faes & María Bordons, 2019. "What characterises funded biomedical research? Evidence from a basic and a clinical domain," Scientometrics, Springer;Akadémiai Kiadó, vol. 119(2), pages 805-825, May.
    9. Marco Cozzi, 2020. "Public Funding of Research and Grant Proposals in the Social Sciences: Empirical Evidence from Canada," Department Discussion Papers 1809, Department of Economics, University of Victoria.
    10. Chiara Franzoni & Paula Stephan & Reinhilde Veugelers, 2022. "Funding Risky Research," Entrepreneurship and Innovation Policy and the Economy, University of Chicago Press, vol. 1(1), pages 103-133.
    11. Conor O’Kane & Jing A. Zhang & Jarrod Haar & James A. Cunningham, 2023. "How scientists interpret and address funding criteria: value creation and undesirable side effects," Small Business Economics, Springer, vol. 61(2), pages 799-826, August.
    12. Charles Ayoubi & Michele Pezzoni & Fabiana Visentin, 2021. "Does It Pay to Do Novel Science? The Selectivity Patterns in Science Funding," Science and Public Policy, Oxford University Press, vol. 48(5), pages 635-648.
    13. Győrffy, Balázs & Herman, Péter & Szabó, István, 2020. "Research funding: past performance is a stronger predictor of future scientific output than reviewer scores," Journal of Informetrics, Elsevier, vol. 14(3).
    14. Marielle Non & Jeroen van Honk & Vince van Houten & Inge van der Weijden & Thed van Leeuwen, 2022. "Getting off to a flying start? The effects of an early-career international mobility grant on scientific performance," CPB Discussion Paper 443, CPB Netherlands Bureau for Economic Policy Analysis.
    15. Marco Seeber & Jef Vlegels & Mattia Cattaneo, 2022. "Conditions that do or do not disadvantage interdisciplinary research proposals in project evaluation," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(8), pages 1106-1126, August.
    16. Lu Liu & Benjamin F. Jones & Brian Uzzi & Dashun Wang, 2023. "Data, measurement and empirical methods in the science of science," Nature Human Behaviour, Nature, vol. 7(7), pages 1046-1058, July.
    17. Walker, James & Brewster, Chris & Fontinha, Rita & Haak-Saheem, Washika & Benigni, Stefano & Lamperti, Fabio & Ribaudo, Dalila, 2022. "The unintended consequences of the pandemic on non-pandemic research activities," Research Policy, Elsevier, vol. 51(1).
    18. Blandinieres, Florence & Pellens, Maikel, 2021. "Scientist's industry engagement and the research agenda: Evidence from Germany," ZEW Discussion Papers 21-001, ZEW - Leibniz Centre for European Economic Research.
    19. Pierre Azoulay & Danielle Li, 2020. "Scientific Grant Funding," NBER Working Papers 26889, National Bureau of Economic Research, Inc.
    20. Nicolas Carayol & Emeric Henry & Marianne Lanoë, 2020. "Stimulating Peer Effects? Evidence from a Research Cluster Policy," Working Papers hal-03874261, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:52:y:2023:i:9:s004873332300152x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.