IDEAS home Printed from https://ideas.repec.org/p/osf/socarx/4z6w8.html
   My bibliography  Save this paper

Gender differences among active reviewers: an investigation based on Publons

Author

Listed:
  • Zhang, Lin
  • Shang, Yuanyuan
  • HUANG, Ying
  • Sivertsen, Gunnar

Abstract

Peer review of scientific manuscripts before publication is essential in scholarly publishing, and most active researchers hold relationships with a number of journals as both an author and a reviewer. There have been several studies focusing on gender balance in academic research and authorship, but fewer studies on our role as reviewers. Publons is a commercial website run by Clarivate Analytics that allows researchers to track and verify their peer review activities and be recognized for it. The platform features over 2 million researchers and 6.9 million reviews for more than 5,000 partnered journals, listing the most active reviewers as “top reviewers”. Our study focuses on gender representation in this ‘top reviewer’ group while also looking at the countries, regions and research fields they represent, as well as the relationship between their roles as authors and reviewers. The results show that male reviewers dominate in almost all countries, regions, and research fields. Male reviewers generally contribute to review work more frequently than females; however, female reviewers write longer reviews. The correlations between reviewing activity and research activity are generally weak overall and within specific research fields. This may reflect that active reviewers are not necessarily the most productive researchers in their fields. What clearly emerges from our results is the need for more concern over gender representation in the quality assurance and gatekeeping functions of scholarly publishing.

Suggested Citation

  • Zhang, Lin & Shang, Yuanyuan & HUANG, Ying & Sivertsen, Gunnar, 2021. "Gender differences among active reviewers: an investigation based on Publons," SocArXiv 4z6w8, Center for Open Science.
    • Handle: RePEc:osf:socarx:4z6w8
    DOI: 10.31219/osf.io/4z6w8
    as

    Download full text from publisher

    File URL: https://osf.io/download/6107b0a3b2d332014eff9897/
    Download Restriction: no
    File URL: https://libkey.io/10.31219/osf.io/4z6w8?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jevin D West & Jennifer Jacquet & Molly M King & Shelley J Correll & Carl T Bergstrom, 2013. "The Role of Gender in Scholarly Authorship," PLOS ONE, Public Library of Science, vol. 8(7), pages 1-6, July.
    2. Jory Lerback & Brooks Hanson, 2017. "Journals invite too few women to referee," Nature, Nature, vol. 541(7638), pages 455-457, January.
    3. Giovanni Abramo & Ciriaco Andrea D’Angelo & Alessandro Caprasecca, 2009. "Gender differences in research productivity: A bibliometric analysis of the Italian academic system," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 517-539, June.
    4. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
    5. Bradford Demarest & Guo Freeman & Cassidy R. Sugimoto, 2014. "The reviewer in the mirror: examining gendered and ethnicized notions of reciprocity in peer review," Scientometrics, Springer;Akadémiai Kiadó, vol. 101(1), pages 717-735, October.
    6. Helena Mihaljević-Brandt & Lucía Santamaría & Marco Tullney, 2016. "The Effect of Gender in the Publication Patterns in Mathematics," PLOS ONE, Public Library of Science, vol. 11(10), pages 1-23, October.
    7. Vincent Larivière & Chaoqun Ni & Yves Gingras & Blaise Cronin & Cassidy R. Sugimoto, 2013. "Bibliometrics: Global gender disparities in science," Nature, Nature, vol. 504(7479), pages 211-213, December.
    8. Xiao Han T Zeng & Jordi Duch & Marta Sales-Pardo & João A G Moreira & Filippo Radicchi & Haroldo V Ribeiro & Teresa K Woodruff & Luís A Nunes Amaral, 2016. "Differences in Collaboration Patterns across Discipline, Career Stage, and Gender," PLOS Biology, Public Library of Science, vol. 14(11), pages 1-19, November.
    9. Michail Kovanis & Raphaël Porcher & Philippe Ravaud & Ludovic Trinquart, 2016. "The Global Burden of Journal Peer Review in the Biomedical Literature: Strong Imbalance in the Collective Enterprise," PLOS ONE, Public Library of Science, vol. 11(11), pages 1-14, November.
    10. Seema Jayachandran, 2015. "The Roots of Gender Inequality in Developing Countries," Annual Review of Economics, Annual Reviews, vol. 7(1), pages 63-88, August.
    11. S. Thurner & R. Hanel, 2011. "Peer-review in a world with rational scientists: Toward selection of the average," The European Physical Journal B: Condensed Matter and Complex Systems, Springer;EDP Sciences, vol. 84(4), pages 707-711, December.
    12. Peter van den Besselaar & Ulf Sandström, 2017. "Vicious circles of gender bias, lower positions, and lower performance: Gender differences in scholarly productivity and impact," PLOS ONE, Public Library of Science, vol. 12(8), pages 1-16, August.
    13. Krawczyk, Michał & Smyk, Magdalena, 2016. "Author׳s gender affects rating of academic articles: Evidence from an incentivized, deception-free laboratory experiment," European Economic Review, Elsevier, vol. 90(C), pages 326-335.
    14. Luke Holman & Devi Stuart-Fox & Cindy E Hauser, 2018. "The gender gap in science: How long until women are equally represented?," PLOS Biology, Public Library of Science, vol. 16(4), pages 1-20, April.
    15. Reingewertz, Yaniv & Lutmar, Carmela, 2018. "Academic in-group bias: An empirical examination of the link between author and journal affiliation," Journal of Informetrics, Elsevier, vol. 12(1), pages 74-86.
    16. José Luis Ortega, 2017. "Are peer-review activities related to reviewer bibliometric performance? A scientometric analysis of Publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 112(2), pages 947-962, August.
    17. Potter Wickware, 1997. "Along the leaky pipeline," Nature, Nature, vol. 390(6656), pages 202-203, November.
    18. Bornmann, Lutz & Williams, Richard, 2017. "Can the journal impact factor be used as a criterion for the selection of junior researchers? A large-scale empirical study based on ResearcherID data," Journal of Informetrics, Elsevier, vol. 11(3), pages 788-799.
    19. Pleun Arensbergen & Inge van der Weijden & Peter Besselaar, 2012. "Gender differences in scientific productivity: a persisting phenomenon?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 857-868, December.
    20. Lu Liu & Yang Wang & Roberta Sinatra & C. Lee Giles & Chaoming Song & Dashun Wang, 2018. "Hot streaks in artistic, cultural, and scientific careers," Nature, Nature, vol. 559(7714), pages 396-399, July.
    21. Rørstad, Kristoffer & Aksnes, Dag W., 2015. "Publication rate expressed by age, gender and academic position – A large-scale analysis of Norwegian academic staff," Journal of Informetrics, Elsevier, vol. 9(2), pages 317-333.
    22. Staša Milojević, 2012. "How Are Academic Age, Productivity and Collaboration Related to Citing Behavior of Researchers?," PLOS ONE, Public Library of Science, vol. 7(11), pages 1-13, November.
    23. Elisabetta Addis & Paola Villa, 2003. "The Editorial Boards of Italian Economics Journals: Women, Gender, and Social Networking," Feminist Economics, Taylor & Francis Journals, vol. 9(1), pages 75-91.
    24. Denis Arruda & Fábio Bezerra & Vânia Almeida Neris & Patricia Rocha De Toro & Jacques Wainera, 2009. "Brazilian computer science research: Gender and regional distributions," Scientometrics, Springer;Akadémiai Kiadó, vol. 79(3), pages 651-665, June.
    25. Junming Huang & Alexander J. Gates & Roberta Sinatra & Albert-László Barabási, 2020. "Historical comparison of gender inequality in scientific careers across countries and disciplines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(9), pages 4609-4616, March.
    26. Hajar Sotudeh & Tahereh Dehdarirad & Jonathan Freer, 2018. "Gender differences in scientific productivity and visibility in core neurosurgery journals: Citations and social media metrics," Research Evaluation, Oxford University Press, vol. 27(3), pages 262-269.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yuanyuan Shang & Gunnar Sivertsen & Zhe Cao & Lin Zhang, 2022. "Gender differences among first authors in research focused on the Sustainable Development Goal of Gender Equality," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4769-4796, August.
    2. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    3. Shang, Yuanyuan & Sivertsen, Gunnar & Cao, Zhe & Zhang, Lin, 2021. "Gender differences in research focused on the Sustainable Development Goal of Gender Equality," SocArXiv 3fapz, Center for Open Science.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    2. Josh Yamamoto & Eitan Frachtenberg, 2022. "Gender Differences in Collaboration Patterns in Computer Science," Publications, MDPI, vol. 10(1), pages 1-21, February.
    3. Roberta Ruggieri & Fabrizio Pecoraro & Daniela Luzi, 2021. "An intersectional approach to analyse gender productivity and open access: a bibliometric analysis of the Italian National Research Council," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(2), pages 1647-1673, February.
    4. Jamal El-Ouahi & Vincent Larivière, 2023. "On the lack of women researchers in the Middle East and North Africa," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(8), pages 4321-4348, August.
    5. Ho Fai Chan & Benno Torgler, 2020. "Gender differences in performance of top cited scientists by field and country," Scientometrics, Springer;Akadémiai Kiadó, vol. 125(3), pages 2421-2447, December.
    6. Hamid R. Jamali & Alireza Abbasi, 2023. "Gender gaps in Australian research publishing, citation and co-authorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2879-2893, May.
    7. Hajibabaei, Anahita & Schiffauerova, Andrea & Ebadi, Ashkan, 2022. "Gender-specific patterns in the artificial intelligence scientific ecosystem," Journal of Informetrics, Elsevier, vol. 16(2).
    8. Antonio De Nicola & Gregorio D’Agostino, 2021. "Assessment of gender divide in scientific communities," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(5), pages 3807-3840, May.
    9. Parminder Bakshi-Hamm & Andreas Hamm, 2022. "Knowledge Production: Analysing Gender- and Country-Dependent Factors in Research Topics through Term Communities," Publications, MDPI, vol. 10(4), pages 1-37, November.
    10. Jyoti Paswan & Vivek Kumar Singh, 2020. "Gender and research publishing analyzed through the lenses of discipline, institution types, impact and international collaboration: a case study from India," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 497-515, April.
    11. Marek Kwiek & Wojciech Roszka, 2022. "Are female scientists less inclined to publish alone? The gender solo research gap," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1697-1735, April.
    12. Sabrina J. Mayer & Justus M. K. Rathmann, 2018. "How does research productivity relate to gender? Analyzing gender differences for multiple publication dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1663-1693, December.
    13. Emre Özel, 2024. "What is Gender Bias in Grant Peer review?," Working Papers halshs-03862027, HAL.
    14. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    15. Abramo, Giovanni & Aksnes, Dag W. & D’Angelo, Ciriaco Andrea, 2021. "Gender differences in research performance within and between countries: Italy vs Norway," Journal of Informetrics, Elsevier, vol. 15(2).
    16. Yongchao Ma & Ying Teng & Zhongzhun Deng & Li Liu & Yi Zhang, 2023. "Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2105-2143, April.
    17. Mohsen Jadidi & Fariba Karimi & Haiko Lietz & Claudia Wagner, 2018. "Gender Disparities In Science? Dropout, Productivity, Collaborations And Success Of Male And Female Computer Scientists," Advances in Complex Systems (ACS), World Scientific Publishing Co. Pte. Ltd., vol. 21(03n04), pages 1-23, May.
    18. Mengyu Yu & Mazie Krehbiel & Samantha Thompson & Tatjana Miljkovic, 2020. "An exploration of gender gap using advanced data science tools: actuarial research community," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(2), pages 767-789, May.
    19. Marina Pilkina & Andrey Lovakov, 2022. "Gender disparities in Russian academia: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3577-3591, June.
    20. Abdelghani Maddi & Yves Gingras, 2021. "Gender Diversity In Research Teams And Citation Impact In Economics And Management," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1381-1404, December.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:osf:socarx:4z6w8. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: OSF (email available below). General contact details of provider: https://arabixiv.org .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.