IDEAS home Printed from https://ideas.repec.org/p/hhs/cesisp/0097.html

Reviewing applications by women - critical use of additive and reasoning evaluation methods

Author

Listed:
  • Melin, Göran

    (SISTER and CESIS)

Abstract

Two programmes regarding research funding are investigated with respect to their evaluation processes. One programme targets individuals and the other centers of excellence. The study attempts to disclose some of the features of the selection procedures and the aim is to contribute with further understanding of the mechanisms in such selection processes, which lead to disproportionate disapproval of female applicants. The use of intuitive or reasoning evaluation methods, together with quantitatively measureable or additive methods, is found to be critical for female applicants. When funding organizations try to advance their evaluation procedures and involve more of reasoning evaluation, there is a risk that other than established main stream projects fail, including applications by women. The paper ends by proposing a hypothesis which may serve as a starting point for further empirical studies.

Suggested Citation

  • Melin, Göran, 2007. "Reviewing applications by women - critical use of additive and reasoning evaluation methods," Working Paper Series in Economics and Institutions of Innovation 97, Royal Institute of Technology, CESIS - Centre of Excellence for Science and Innovation Studies.
    • Handle: RePEc:hhs:cesisp:0097
    as

    Download full text from publisher

    File URL: https://static.sys.kth.se/itm/wp/cesis/cesiswp97.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Christine Wennerås & Agnes Wold, 1997. "Nepotism and sexism in peer-review," Nature, Nature, vol. 387(6631), pages 341-343, May.
    2. Liv Langfeldt, 2006. "The policy challenges of peer review: managing bias, conflict of interests and interdisciplinary assessments," Research Evaluation, Oxford University Press, vol. 15(1), pages 31-41, April.
    3. Göran Melin & Rickard Danell, 2006. "The top eight percent: Development of approved and rejected applicants for a prestigious grant in Sweden," Science and Public Policy, Oxford University Press, vol. 33(10), pages 702-712, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Albert Banal-Estañol & Qianshuo Liu & Inés Macho-Stadler & David Pérez-Castrillo, 2021. "Similar-to-me Effects in the Grant Application Process: Applicants, Panelists, and the Likelihood of Obtaining Funds," Working Papers 1289, Barcelona School of Economics.
    2. Tóth, Tamás & Demeter, Márton & Csuhai, Sándor & Major, Zsolt Balázs, 2024. "When career-boosting is on the line: Equity and inequality in grant evaluation, productivity, and the educational backgrounds of Marie Skłodowska-Curie Actions individual fellows in social sciences an," Journal of Informetrics, Elsevier, vol. 18(2).
    3. Lettice, Fiona & Smart, Palie & Baruch, Yehuda & Johnson, Mark, 2012. "Navigating the impact-innovation double hurdle: The case of a climate change research fund," Research Policy, Elsevier, vol. 41(6), pages 1048-1057.
    4. Benda, Wim G.G. & Engels, Tim C.E., 2011. "The predictive validity of peer review: A selective review of the judgmental forecasting qualities of peers, and implications for innovation in science," International Journal of Forecasting, Elsevier, vol. 27(1), pages 166-182.
    5. Benda, Wim G.G. & Engels, Tim C.E., 2011. "The predictive validity of peer review: A selective review of the judgmental forecasting qualities of peers, and implications for innovation in science," International Journal of Forecasting, Elsevier, vol. 27(1), pages 166-182, January.
    6. Banal-Estañol, Albert & Macho-Stadler, Inés & Pérez-Castrillo, David, 2019. "Evaluation in research funding agencies: Are structurally diverse teams biased against?," Research Policy, Elsevier, vol. 48(7), pages 1823-1840.
    7. Wang, Qi & Sandström, Ulf, 2014. "Defining the Role of Cognitive Distance in the Peer Review Process: Explorative Study of a Grant Scheme in Infection Biology," INDEK Working Paper Series 2014/10, Royal Institute of Technology, Department of Industrial Economics and Management.
    8. repec:plo:pone00:0086969 is not listed on IDEAS
    9. Rafols, Ismael & Leydesdorff, Loet & O’Hare, Alice & Nightingale, Paul & Stirling, Andy, 2012. "How journal rankings can suppress interdisciplinary research: A comparison between Innovation Studies and Business & Management," Research Policy, Elsevier, vol. 41(7), pages 1262-1282.
    10. van den Besselaar, Peter & Sandström, Ulf, 2015. "Early career grants, performance, and careers: A study on predictive validity of grant decisions," Journal of Informetrics, Elsevier, vol. 9(4), pages 826-838.
    11. Patrícia Martinková & Dan Goldhaber & Elena Erosheva, 2018. "Disparities in ratings of internal and external applicants: A case for model-based inter-rater reliability," PLOS ONE, Public Library of Science, vol. 13(10), pages 1-17, October.
    12. Rodríguez Sánchez, Isabel & Makkonen, Teemu & Williams, Allan M., 2019. "Peer review assessment of originality in tourism journals: critical perspective of key gatekeepers," Annals of Tourism Research, Elsevier, vol. 77(C), pages 1-11.
    13. Amy Hinsley & William J Sutherland & Alison Johnston, 2017. "Men ask more questions than women at a scientific conference," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-14, October.
    14. van Raan, A. F. J. & van Leeuwen, Th. N., 2002. "Assessment of the scientific basis of interdisciplinary, applied research: Application of bibliometric methods in Nutrition and Food Research," Research Policy, Elsevier, vol. 31(4), pages 611-632, May.
    15. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
    16. repec:dau:papers:123456789/8741 is not listed on IDEAS
    17. Fengyuan Liu & Petter Holme & Matteo Chiesa & Bedoor AlShebli & Talal Rahwan, 2023. "Gender inequality and self-publication are common among academic editors," Nature Human Behaviour, Nature, vol. 7(3), pages 353-364, March.
    18. Marta Vohlídalová, 2021. "Early-Career Women Academics: Between Neoliberalism and Gender Conservatism," Sociological Research Online, , vol. 26(1), pages 27-43, March.
    19. Pat O’Connor & Gemma Irvine, 2020. "Multi-Level State Interventions and Gender Equality in Higher Education Institutions: The Irish Case," Administrative Sciences, MDPI, vol. 10(4), pages 1-21, December.
    20. Karen L. Webber & Manuel González Canché, 2018. "Is There a Gendered Path to Tenure? A Multi-State Approach to Examine the Academic Trajectories of U.S. Doctoral Recipients in the Sciences," Research in Higher Education, Springer;Association for Institutional Research, vol. 59(7), pages 897-932, November.
    21. Friederike Mengel & Jan Sauermann & Ulf Zölitz, 2019. "Gender Bias in Teaching Evaluations," Journal of the European Economic Association, European Economic Association, vol. 17(2), pages 535-566.
    22. Youtie, Jan & Rogers, Juan & Heinze, Thomas & Shapira, Philip & Tang, Li, 2013. "Career-based influences on scientific recognition in the United States and Europe: Longitudinal evidence from curriculum vitae data," Research Policy, Elsevier, vol. 42(8), pages 1341-1355.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • Z13 - Other Special Topics - - Cultural Economics - - - Economic Sociology; Economic Anthropology; Language; Social and Economic Stratification

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:hhs:cesisp:0097. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Vardan Hovsepyan (email available below). General contact details of provider: https://edirc.repec.org/data/cekthse.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.