IDEAS home Printed from https://ideas.repec.org/a/eee/respol/v51y2022i1s0048733321001955.html
   My bibliography  Save this article

Gender-equal funding rates conceal unequal evaluations

Author

Listed:
  • Bol, Thijs
  • de Vaan, Mathijs
  • van de Rijt, Arnout

Abstract

Previous studies have found little or no systematic differences in the rates at which female and male scientists are awarded funding in international grant competitions. However, past investigations have only studied outcomes, not the preceding scoring and selection process. We propose that common grant review practices–such as panel deliberations, score binning, and interview assessments–allow unequal evaluations to be corrected while staying within a framework of merit-based review. We analyzed unique data from a large funding competition, the Netherlands’ Organization for Scientific Research's Talent Program, including reviewer and panel evaluation scores of both funded and unfunded proposals. We replicate prior research demonstrating gender equity in funding outcomes. At the same time, we find that men received higher evaluation scores, consistent with our argument. This gender difference is counteracted by panels funding women with lower scores than men's, redistributing 64 million euro back to women that would otherwise have gone to men. Our study thus reveals that female scientists are more poorly evaluated than their male counterparts in spite of what equality in outcome statistics might suggest.

Suggested Citation

  • Bol, Thijs & de Vaan, Mathijs & van de Rijt, Arnout, 2022. "Gender-equal funding rates conceal unequal evaluations," Research Policy, Elsevier, vol. 51(1).
  • Handle: RePEc:eee:respol:v:51:y:2022:i:1:s0048733321001955
    DOI: 10.1016/j.respol.2021.104399
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0048733321001955
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.respol.2021.104399?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Manuel Bagues & Mauro Sylos-Labini & Natalia Zinovyeva, 2017. "Does the Gender Composition of Scientific Committees Matter?," American Economic Review, American Economic Association, vol. 107(4), pages 1207-1238, April.
    2. Muriel Niederle & Lise Vesterlund, 2007. "Do Women Shy Away From Competition? Do Men Compete Too Much?," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(3), pages 1067-1101.
    3. Ginther, Donna K. & Heggeness, Misty L., 2020. "Administrative discretion in scientific funding: Evidence from a prestigious postdoctoral training program✰," Research Policy, Elsevier, vol. 49(4).
    4. Lawson, Cornelia & Geuna, Aldo & Finardi, Ugo, 2021. "The funding-productivity-gender nexus in science, a multistage analysis," Research Policy, Elsevier, vol. 50(3).
    5. Cecilia Rouse & Claudia Goldin, 2000. "Orchestrating Impartiality: The Impact of "Blind" Auditions on Female Musicians," American Economic Review, American Economic Association, vol. 90(4), pages 715-741, September.
    6. Goldin, Claudia D. & Rouse, Cecilia, 2000. "Orchestrating Impartiality: The Impact of “Blind†Auditions on Female Musicians," Scholarly Articles 30703974, Harvard University Department of Economics.
    7. Donna K. Ginther & Misty L. Heggeness, 2020. "Administrative Discretion in Scientific Funding: Evidence from a Prestigious Postdoctoral Training Program," NBER Working Papers 26841, National Bureau of Economic Research, Inc.
    8. Upali W. Jayasinghe & Herbert W. Marsh & Nigel Bond, 2003. "A multilevel cross‐classified modelling approach to peer review of grant proposals: the effects of assessor and researcher attributes on assessor ratings," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 166(3), pages 279-300, October.
    9. Bornmann, Lutz & Mutz, Rüdiger & Daniel, Hans-Dieter, 2007. "Gender differences in grant peer review: A meta-analysis," Journal of Informetrics, Elsevier, vol. 1(3), pages 226-238.
    10. Paul J. Boyle & Lucy K. Smith & Nicola J. Cooper & Kate S. Williams & Henrietta O'Connor, 2015. "Gender balance: Women are funded more fairly in social science," Nature, Nature, vol. 525(7568), pages 181-183, September.
    11. Patrick S. Forscher & William T. L. Cox & Markus Brauer & Patricia G. Devine, 2019. "Little race or gender bias in an experiment of initial review of NIH R01 grant proposals," Nature Human Behaviour, Nature, vol. 3(3), pages 257-264, March.
    12. Donna K. Ginther & Kathy J. Hayes, 2003. "Gender Differences in Salary and Promotion for Faculty in the Humanities 1977–95," Journal of Human Resources, University of Wisconsin Press, vol. 38(1).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lawson, Cornelia & Salter, Ammon, 2023. "Exploring the effect of overlapping institutional applications on panel decision-making," Research Policy, Elsevier, vol. 52(9).
    2. Albers, Casper J & van der Molen, Sense Jan, 2022. "Gender effects in Dutch research funding," SocArXiv dpn2j, Center for Open Science.
    3. Mancuso, Raffaele & Rossi-Lamastra, Cristina & Franzoni, Chiara, 2023. "Topic choice, gendered language, and the under-funding of female scholars in mission-oriented research," Research Policy, Elsevier, vol. 52(6).
    4. Stefano Bianchini & Patrick Llerena & Sıla Öcalan-Özel & Emre Özel, 2022. "Gender diversity of research consortia contributes to funding decisions in a multi-stage grant peer-review process," Palgrave Communications, Palgrave Macmillan, vol. 9(1), pages 1-10, December.
    5. Emre Özel, 2024. "What is Gender Bias in Grant Peer review?," Working Papers halshs-03862027, HAL.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laura Hospido & Luc Laeven & Ana Lamo, 2022. "The Gender Promotion Gap: Evidence from Central Banking," The Review of Economics and Statistics, MIT Press, vol. 104(5), pages 981-996, December.
    2. Laura Hospido & Carlos Sanz, 2021. "Gender Gaps in the Evaluation of Research: Evidence from Submissions to Economics Conferences," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 83(3), pages 590-618, June.
    3. Laura Hospido & Carlos Sanz, 2019. "Gender gaps in the evaluation of research: evidence from submissions to economics conferences (Updated March 2020)," Working Papers 1918, Banco de España, revised Mar 2020.
    4. Maria De Paola & Michela Ponzo & Vincenzo Scoppa, 2018. "Are Men Given Priority for Top Jobs? Investigating the Glass Ceiling in Italian Academia," Journal of Human Capital, University of Chicago Press, vol. 12(3), pages 475-503.
    5. Ludwig, Sandra & Fellner-Röhling, Gerlinde & Thoma, Carmen, 2017. "Do women have more shame than men? An experiment on self-assessment and the shame of overestimating oneself," European Economic Review, Elsevier, vol. 92(C), pages 31-46.
    6. Cohen-Zada, Danny & Krumer, Alex & Rosenboim, Mosi & Shapir, Offer Moshe, 2017. "Choking under pressure and gender: Evidence from professional tennis," Journal of Economic Psychology, Elsevier, vol. 61(C), pages 176-190.
    7. Chen Liang & Yili Hong & Bin Gu & Jing Peng, 2018. "Gender Wage Gap in Online Gig Economy and Gender Differences in Job Preferences," Working Papers 18-03, NET Institute.
    8. Maggian, Valeria & Montinari, Natalia & Nicolò, Antonio, 2020. "Do quotas help women to climb the career ladder? A laboratory experiment," European Economic Review, Elsevier, vol. 123(C).
    9. Fang, Sheng & Goh, Chorching & Roberts, Mark & Xu, Lixin Colin & Zeufack, Albert, 2022. "Female entrepreneurs and productivity around the world: Rule of law, network, culture, and gender equality," World Development, Elsevier, vol. 154(C).
    10. Ilse Lindenlaub & Anja Prummer, 2014. "Gender, Social Networks And Performance," Cambridge Working Papers in Economics 1461, Faculty of Economics, University of Cambridge.
    11. Gagnon, Nickolas & Bosmans, Kristof & Riedl, Arno, 2020. "The Effect of Unfair Chances and Gender Discrimination on Labor Supply," IZA Discussion Papers 12912, Institute of Labor Economics (IZA).
    12. Lamo, Ana & Laeven, Luc, 2019. "The gender promotion gap: what holds back female economists from making a career in central banking?," Research Bulletin, European Central Bank, vol. 63.
    13. Osorio, António (António Miguel), 2019. "Gender differences in competition: gender equality and cost reduction policies," Working Papers 2072/351587, Universitat Rovira i Virgili, Department of Economics.
    14. Lavy, Victor & Sand, Edith, 2015. "On The Origins of Gender Human Capital Gaps: Short and Long Term Consequences of Teachers’ Stereotypical Biases," The Warwick Economics Research Paper Series (TWERPS) 1085, University of Warwick, Department of Economics.
    15. Xinlei (Jack) Chen & Xiaohua Zeng & Cheng Zhang, 2023. "Does Concealing Gender Identity Help Women Win the Competition? An Empirical Investigation into Online Video Games," Marketing Science, INFORMS, vol. 42(3), pages 551-568, May.
    16. Popov, Alexander & Zaharia, Sonia, 2019. "Credit market competition and the gender gap in labor force participation: Evidence from local markets," European Economic Review, Elsevier, vol. 115(C), pages 25-59.
    17. Catherine Eckel & Lata Gangadharan & Philip J. Grossman & Nina Xue, 2021. "The gender leadership gap: insights from experiments," Chapters, in: Ananish Chaudhuri (ed.), A Research Agenda for Experimental Economics, chapter 7, pages 137-162, Edward Elgar Publishing.
    18. Paola Sapienza, 2010. "Discussion of Self‐Selection and the Forecasting Abilities of Female Equity Analysts," Journal of Accounting Research, Wiley Blackwell, vol. 48(2), pages 437-443, May.
    19. Iris Bohnet & Alexandra van Geen & Max Bazerman, 2016. "When Performance Trumps Gender Bias: Joint vs. Separate Evaluation," Management Science, INFORMS, vol. 62(5), pages 1225-1234, May.
    20. Shane Thompson, 2017. "College Advising And Gender," Economic Inquiry, Western Economic Association International, vol. 55(2), pages 1007-1016, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:respol:v:51:y:2022:i:1:s0048733321001955. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/respol .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.