IDEAS home Printed from https://ideas.repec.org/a/spr/scient/v128y2023i4d10.1007_s11192-023-04666-w.html
   My bibliography  Save this article

Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis

Author

Listed:
  • Yongchao Ma

    (Huazhong University of Science & Technology
    City University of Hong Kong)

  • Ying Teng

    (City University of Hong Kong)

  • Zhongzhun Deng

    (Sichuan University)

  • Li Liu

    (Huazhong University of Science & Technology)

  • Yi Zhang

    (Huazhong University of Science & Technology)

Abstract

“Achieve gender equality and empower all women and girls” is essential to reduce gender disparity and improve the status of women. But it remains a challenge to narrow gender differences and improve gender equality in academic research. In this paper, we propose that the impact of articles is lower and writing style of articles is less positive when the article’s first author is female relative to male first authors, and writing style mediates this relationship. Focusing on the positive writing style, we attempt to contribute and explain the research on gender differences in research performance. We use BERT-based textual sentiment analysis to analyse 87 years of 9820 articles published in the top four marketing journals and prove our hypotheses. We also consider a set of control variables and conduct a set of robustness checks to ensure the robustness of our findings. We discuss the theoretical and managerial implications of our findings for researchers.

Suggested Citation

  • Yongchao Ma & Ying Teng & Zhongzhun Deng & Li Liu & Yi Zhang, 2023. "Does writing style affect gender differences in the research performance of articles?: An empirical study of BERT-based textual sentiment analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(4), pages 2105-2143, April.
  • Handle: RePEc:spr:scient:v:128:y:2023:i:4:d:10.1007_s11192-023-04666-w
    DOI: 10.1007/s11192-023-04666-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11192-023-04666-w
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11192-023-04666-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhu, Dong Hong & Deng, Zhong Zhun & Chang, Ya Ping, 2020. "Understanding the influence of submission devices on online consumer reviews:A comparison between smartphones and PCs," Journal of Retailing and Consumer Services, Elsevier, vol. 54(C).
    2. Mahmood Khosrowjerdi & Lutz Bornmann, 2019. "Is culture related to strong science? An empirical investigation," Papers 1909.04521, arXiv.org, revised Apr 2021.
    3. Zhu, Bangzhu & Xu, Chenxin & Wang, Ping & Zhang, Lin, 2022. "How does internal carbon pricing affect corporate environmental performance?," Journal of Business Research, Elsevier, vol. 145(C), pages 65-77.
    4. Vincent Larivière & Chaoqun Ni & Yves Gingras & Blaise Cronin & Cassidy R. Sugimoto, 2013. "Bibliometrics: Global gender disparities in science," Nature, Nature, vol. 504(7479), pages 211-213, December.
    5. Kyle R. Myers & Wei Yang Tham & Yian Yin & Nina Cohodes & Jerry G. Thursby & Marie C. Thursby & Peter Schiffer & Joseph T. Walsh & Karim R. Lakhani & Dashun Wang, 2020. "Unequal effects of the COVID-19 pandemic on scientists," Nature Human Behaviour, Nature, vol. 4(9), pages 880-883, September.
    6. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    7. Zhu, Nibing & Liu, Chang & Yang, Zhilin, 2021. "Team Size, Research Variety, and Research Performance: Do Coauthors’ Coauthors Matter?," Journal of Informetrics, Elsevier, vol. 15(4).
    8. Pleun Arensbergen & Inge van der Weijden & Peter Besselaar, 2012. "Gender differences in scientific productivity: a persisting phenomenon?," Scientometrics, Springer;Akadémiai Kiadó, vol. 93(3), pages 857-868, December.
    9. Jesus Palomo & Cristina Figueroa-Domecq & Pilar Laguna, 2017. "Women, peace and security state-of-art: a bibliometric analysis in social sciences based on SCOPUS database," Scientometrics, Springer;Akadémiai Kiadó, vol. 113(1), pages 123-148, October.
    10. Vincent Larivière & Rodrigo Costas, 2016. "How Many Is Too Many? On the Relationship between Research Productivity and Impact," PLOS ONE, Public Library of Science, vol. 11(9), pages 1-10, September.
    11. Yoo, Boonghee, 2009. "Developing an overall ranking of 79 marketing journals: An introduction of PRINQUAL to marketing," Australasian marketing journal, Elsevier, vol. 17(3), pages 160-174.
    12. Yuanyuan Shang & Gunnar Sivertsen & Zhe Cao & Lin Zhang, 2022. "Gender differences among first authors in research focused on the Sustainable Development Goal of Gender Equality," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4769-4796, August.
    13. Khosrowjerdi, Mahmood & Bornmann, Lutz, 2021. "Is culture related to strong science? An empirical investigation," Journal of Informetrics, Elsevier, vol. 15(4).
    14. repec:oup:jconrs:v:47:y:2021:i:5:p:675-697. is not listed on IDEAS
    15. Ana Jesús López & Dolores Pereira, 2021. "The Value of Transfer of Knowledge in Bridging the Gender Gap in STEM," Sustainability, MDPI, vol. 13(10), pages 1-15, May.
    16. Zhang, Mengya & Zhang, Gupeng & Liu, Yun & Zhai, Xiaorong & Han, Xinying, 2020. "Scientists’ genders and international academic collaboration: An empirical study of Chinese universities and research institutes," Journal of Informetrics, Elsevier, vol. 14(4).
    17. Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    18. Thelwall, Mike & Bailey, Carol & Makita, Meiko & Sud, Pardeep & Madalli, Devika P., 2019. "Gender and research publishing in India: Uniformly high inequality?," Journal of Informetrics, Elsevier, vol. 13(1), pages 118-131.
    19. Abramo, Giovanni & Cicero, Tindaro & D’Angelo, Ciriaco Andrea, 2015. "Should the research performance of scientists be distinguished by gender?," Journal of Informetrics, Elsevier, vol. 9(1), pages 25-38.
    20. Abramo, Giovanni & Aksnes, Dag W. & D’Angelo, Ciriaco Andrea, 2021. "Gender differences in research performance within and between countries: Italy vs Norway," Journal of Informetrics, Elsevier, vol. 15(2).
    21. Sabrina J. Mayer & Justus M. K. Rathmann, 2018. "How does research productivity relate to gender? Analyzing gender differences for multiple publication dimensions," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 1663-1693, December.
    22. Stefan Stremersch & Peter C. Verhoef, 2005. "Globalization of Authorship in the Marketing Discipline: Does It Help or Hinder the Field?," Marketing Science, INFORMS, vol. 24(4), pages 585-594, February.
    23. Junming Huang & Alexander J. Gates & Roberta Sinatra & Albert-László Barabási, 2020. "Historical comparison of gender inequality in scientific careers across countries and disciplines," Proceedings of the National Academy of Sciences, Proceedings of the National Academy of Sciences, vol. 117(9), pages 4609-4616, March.
    24. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Costa, 2019. "A gender analysis of top scientists’ collaboration behavior: evidence from Italy," Scientometrics, Springer;Akadémiai Kiadó, vol. 120(2), pages 405-418, August.
    25. Elba Mauleón & María Bordons, 2006. "Productivity, impact and publication habits by gender in the area of Materials Science," Scientometrics, Springer;Akadémiai Kiadó, vol. 66(1), pages 199-218, January.
    26. Horbach, Serge P.J.M. & Schneider, Jesper W. & Sainte-Marie, Maxime, 2022. "Ungendered writing: Writing styles are unlikely to account for gender differences in funding rates in the natural and technical sciences," Journal of Informetrics, Elsevier, vol. 16(4).
    27. Jyoti Paswan & Vivek Kumar Singh, 2020. "Gender and research publishing analyzed through the lenses of discipline, institution types, impact and international collaboration: a case study from India," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 497-515, April.
    28. Jiang, Ling (Alice) & Zhu, Nibing & Yang, Zhilin & Xu, Shen & Jun, Minjoon, 2018. "The relationships between distance factors and international collaborative research outcomes: A bibliometric examination," Journal of Informetrics, Elsevier, vol. 12(3), pages 618-630.
    29. Natalia Restrepo & Alfonso Unceta & Xabier Barandiaran, 2021. "Gender Diversity in Research and Innovation Projects: The Proportion of Women in the Context of Higher Education," Sustainability, MDPI, vol. 13(9), pages 1-21, May.
    30. United Nations UN, 2015. "Transforming our World: the 2030 Agenda for Sustainable Development," Working Papers id:7559, eSocialSciences.
    31. Liu, Meijun & Zhang, Ning & Hu, Xiao & Jaiswal, Ajay & Xu, Jian & Chen, Hong & Ding, Ying & Bu, Yi, 2022. "Further divided gender gaps in research productivity and collaboration during the COVID-19 pandemic: Evidence from coronavirus-related literature," Journal of Informetrics, Elsevier, vol. 16(2).
    32. Mike Thelwall, 2018. "Do gendered citation advantages influence field participation? Four unusual fields in the USA 1996–2017," Scientometrics, Springer;Akadémiai Kiadó, vol. 117(3), pages 2133-2144, December.
    33. Ju Wen & Lei Lei, 2022. "Adjectives and adverbs in life sciences across 50 years: implications for emotions and readability in academic texts," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(8), pages 4731-4749, August.
    34. Zhang, Guangyao & Xu, Shenmeng & Sun, Yao & Jiang, Chunlin & Wang, Xianwen, 2022. "Understanding the peer review endeavor in scientific publishing," Journal of Informetrics, Elsevier, vol. 16(2).
    35. Peter van den Besselaar & Ulf Sandström, 2016. "Gender differences in research performance and its impact on careers: a longitudinal case study," Scientometrics, Springer;Akadémiai Kiadó, vol. 106(1), pages 143-162, January.
    36. Lerchenmueller, Marc J. & Sorenson, Olav, 2018. "The gender gap in early career transitions in the life sciences," Research Policy, Elsevier, vol. 47(6), pages 1007-1017.
    37. Xinshu Zhao & John G. Lynch & Qimei Chen, 2010. "Reconsidering Baron and Kenny: Myths and Truths about Mediation Analysis," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(2), pages 197-206, August.
    38. Zhou-min Yuan & Mingxin Yao, 2022. "Is academic writing becoming more positive? A large-scale diachronic case study of Science research articles across 25 years," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(11), pages 6191-6207, November.
    39. Giovanni Abramo & Ciriaco Andrea D’Angelo & Flavia Di Costa, 2019. "The collaboration behavior of top scientists," Scientometrics, Springer;Akadémiai Kiadó, vol. 118(1), pages 215-232, January.
    40. Anthony Salerno & Juliano Laran & Chris Janiszewski & Darren W Dahl & Linda L Price & Cait Lamberton, 2019. "The Bad Can Be Good: When Benign and Malicious Envy Motivate Goal Pursuit," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 46(2), pages 388-405.
    41. Julian Kolev & Yuly Fuentes-Medel & Fiona Murray, 2019. "Is Blinded Review Enough? How Gendered Outcomes Arise Even Under Anonymous Evaluation," NBER Working Papers 25759, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin Zhang & Gunnar Sivertsen & Huiying Du & Ying Huang & Wolfgang Glänzel, 2021. "Gender differences in the aims and impacts of research," Scientometrics, Springer;Akadémiai Kiadó, vol. 126(11), pages 8861-8886, November.
    2. Hajibabaei, Anahita & Schiffauerova, Andrea & Ebadi, Ashkan, 2022. "Gender-specific patterns in the artificial intelligence scientific ecosystem," Journal of Informetrics, Elsevier, vol. 16(2).
    3. Jyoti Paswan & Vivek Kumar Singh, 2020. "Gender and research publishing analyzed through the lenses of discipline, institution types, impact and international collaboration: a case study from India," Scientometrics, Springer;Akadémiai Kiadó, vol. 123(1), pages 497-515, April.
    4. Lin Zhang & Yuanyuan Shang & Ying Huang & Gunnar Sivertsen, 2022. "Gender differences among active reviewers: an investigation based on publons," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(1), pages 145-179, January.
    5. Kwiek, Marek & Roszka, Wojciech, 2021. "Gender-based homophily in research: A large-scale study of man-woman collaboration," Journal of Informetrics, Elsevier, vol. 15(3).
    6. Zhang, Lin & Shang, Yuanyuan & HUANG, Ying & Sivertsen, Gunnar, 2021. "Gender differences among active reviewers: an investigation based on Publons," SocArXiv 4z6w8, Center for Open Science.
    7. Shen, Hongquan & Xie, Juan & Ao, Weiyi & Cheng, Ying, 2022. "The continuity and citation impact of scientific collaboration with different gender composition," Journal of Informetrics, Elsevier, vol. 16(1).
    8. Shen, Hongquan & Cheng, Ying & Ju, Xiufang & Xie, Juan, 2022. "Rethinking the effect of inter-gender collaboration on research performance for scholars," Journal of Informetrics, Elsevier, vol. 16(4).
    9. Hamid R. Jamali & Alireza Abbasi, 2023. "Gender gaps in Australian research publishing, citation and co-authorship," Scientometrics, Springer;Akadémiai Kiadó, vol. 128(5), pages 2879-2893, May.
    10. Marek Kwiek & Wojciech Roszka, 2021. "Gender Disparities In International Research Collaboration: A Study Of 25,000 University Professors," Journal of Economic Surveys, Wiley Blackwell, vol. 35(5), pages 1344-1380, December.
    11. Liu, Meijun & Zhang, Ning & Hu, Xiao & Jaiswal, Ajay & Xu, Jian & Chen, Hong & Ding, Ying & Bu, Yi, 2022. "Further divided gender gaps in research productivity and collaboration during the COVID-19 pandemic: Evidence from coronavirus-related literature," Journal of Informetrics, Elsevier, vol. 16(2).
    12. Zhang, Lin & Sivertsen, Gunnar & Du, Huiying & HUANG, Ying & Glänzel, Wolfgang, 2021. "Gender differences in the aims and impacts of research," SocArXiv 9n347, Center for Open Science.
    13. Marina Pilkina & Andrey Lovakov, 2022. "Gender disparities in Russian academia: a bibliometric analysis," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(6), pages 3577-3591, June.
    14. Loarne-Lemaire, Séverine Le & Bertrand, Gaël & Razgallah, Meriam & Maalaoui, Adnane & Kallmuenzer, Andreas, 2021. "Women in innovation processes as a solution to climate change: A systematic literature review and an agenda for future research," Technological Forecasting and Social Change, Elsevier, vol. 164(C).
    15. Mancuso, Raffaele & Rossi-Lamastra, Cristina & Franzoni, Chiara, 2023. "Topic choice, gendered language, and the under-funding of female scholars in mission-oriented research," Research Policy, Elsevier, vol. 52(6).
    16. Marek Kwiek & Wojciech Roszka, 2022. "Are female scientists less inclined to publish alone? The gender solo research gap," Scientometrics, Springer;Akadémiai Kiadó, vol. 127(4), pages 1697-1735, April.
    17. Zhang, Ning & He, Guangye & Shi, Dongbo & Zhao, Zhenyue & Li, Jiang, 2022. "Does a gender-neutral name associate with the research impact of a scientist?," Journal of Informetrics, Elsevier, vol. 16(1).
    18. Yu, Xiaoyao & Szymanski, Boleslaw K. & Jia, Tao, 2021. "Become a better you: Correlation between the change of research direction and the change of scientific performance," Journal of Informetrics, Elsevier, vol. 15(3).
    19. Abramo, Giovanni & Aksnes, Dag W. & D’Angelo, Ciriaco Andrea, 2021. "Gender differences in research performance within and between countries: Italy vs Norway," Journal of Informetrics, Elsevier, vol. 15(2).
    20. Liu, Meijun & Jaiswal, Ajay & Bu, Yi & Min, Chao & Yang, Sijie & Liu, Zhibo & Acuña, Daniel & Ding, Ying, 2022. "Team formation and team impact: The balance between team freshness and repeat collaboration," Journal of Informetrics, Elsevier, vol. 16(4).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:scient:v:128:y:2023:i:4:d:10.1007_s11192-023-04666-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.