IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v14y2022i16p9939-d885794.html
   My bibliography  Save this article

Machine-Learning-Based Gender Distribution Prediction from Anonymous News Comments: The Case of Korean News Portal

Author

Listed:
  • Jong Hwan Suh

    (Department of Management Information Systems & BERI, Gyeongsang National University, 501 Jinjudae-ro, Jinju-si 52828, Korea)

Abstract

Anonymous news comment data from a news portal in South Korea, naver.com, can help conduct gender research and resolve related issues for sustainable societies. Nevertheless, only a small portion of gender information (i.e., gender distribution) is open to the public, and therefore, it has rarely been considered for gender research. Hence, this paper aims to resolve the matter of incomplete gender information and make the anonymous news comment data usable for gender research as new social media big data. This paper proposes a machine-learning-based approach for predicting the gender distribution (i.e., male and female rates) of anonymous news commenters for a news article. Initially, the big data of news articles and their anonymous news comments were collected and divided into labeled and unlabeled datasets (i.e., with and without gender information). The word2vec approach was employed to represent a news article by the characteristics of the news comments. Then, using the labeled dataset, various prediction techniques were evaluated for predicting the gender distribution of anonymous news commenters for a labeled news article. As a result, the neural network was selected as the best prediction technique, and it could accurately predict the gender distribution of anonymous news commenters of the labeled news article. Thus, this study showed that a machine-learning-based approach can overcome the incomplete gender information problem of anonymous social media users. Moreover, when the gender distributions of the unlabeled news articles were predicted using the best neural network model, trained with the labeled dataset, their distribution turned out different from the labeled news articles. The result indicates that using only the labeled dataset for gender research can result in misleading findings and distorted conclusions. The predicted gender distributions for the unlabeled news articles can help to better understand anonymous news commenters as humans for sustainable societies. Eventually, this study provides a new way for data-driven computational social science with incomplete and anonymous social media big data.

Suggested Citation

  • Jong Hwan Suh, 2022. "Machine-Learning-Based Gender Distribution Prediction from Anonymous News Comments: The Case of Korean News Portal," Sustainability, MDPI, vol. 14(16), pages 1-17, August.
    • Handle: RePEc:gam:jsusta:v:14:y:2022:i:16:p:9939-:d:885794
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/14/16/9939/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/14/16/9939/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Suh, Jong Hwan, 2015. "Forecasting the daily outbreak of topic-level political risk from social media using hidden Markov model-based techniques," Technological Forecasting and Social Change, Elsevier, vol. 94(C), pages 115-132.
    2. Teso, E. & Olmedilla, M. & Martínez-Torres, M.R. & Toral, S.L., 2018. "Application of text mining techniques to the analysis of discourse in eWOM communications from a gender perspective," Technological Forecasting and Social Change, Elsevier, vol. 129(C), pages 131-142.
    3. Jong Hwan Suh, 2019. "SocialTERM-Extractor: Identifying and Predicting Social-Problem-Specific Key Noun Terms from a Large Number of Online News Articles Using Text Mining and Machine Learning Techniques," Sustainability, MDPI, vol. 11(1), pages 1-44, January.
    4. Robin Hirt & Niklas Kühl & Gerhard Satzger, 2019. "Cognitive computing for customer profiling: meta classification for gender prediction," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(1), pages 93-106, March.
    5. H Andrew Schwartz & Johannes C Eichstaedt & Margaret L Kern & Lukasz Dziurzynski & Stephanie M Ramones & Megha Agrawal & Achal Shah & Michal Kosinski & David Stillwell & Martin E P Seligman & Lyle H U, 2013. "Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach," PLOS ONE, Public Library of Science, vol. 8(9), pages 1-16, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Karel Hrazdil & Jiri Novak & Rafael Rogo & Christine Wiedman & Ray Zhang, 2020. "Measuring executive personality using machine‐learning algorithms: A new approach and audit fee‐based validation tests," Journal of Business Finance & Accounting, Wiley Blackwell, vol. 47(3-4), pages 519-544, March.
    2. Luo, Shuli & He, Sylvia Y., 2021. "Understanding gender difference in perceptions toward transit services across space and time: A social media mining approach," Transport Policy, Elsevier, vol. 111(C), pages 63-73.
    3. Gow, Ian D. & Kaplan, Steven N. & Larcker, David F. & Zakolyukina, Anastasia A., 2016. "CEO Personality and Firm Policies," Research Papers 3444, Stanford University, Graduate School of Business.
    4. Mikkel Wallentin, 2018. "Sex differences in post-stroke aphasia rates are caused by age. A meta-analysis and database query," PLOS ONE, Public Library of Science, vol. 13(12), pages 1-18, December.
    5. Hannes Rosenbusch & Maya Aghaei & Anthony M. Evans & Marcel Zeelenberg, 2021. "Psychological trait inferences from women’s clothing: human and machine prediction," Journal of Computational Social Science, Springer, vol. 4(2), pages 479-501, November.
    6. Rachel Winter & Anna Lavis, 2021. "The Impact of COVID-19 on Young People’s Mental Health in the UK: Key Insights from Social Media Using Online Ethnography," IJERPH, MDPI, vol. 19(1), pages 1-13, December.
    7. Lushi Chen & Tao Gong & Michal Kosinski & David Stillwell & Robert L Davidson, 2017. "Building a profile of subjective well-being for social media users," PLOS ONE, Public Library of Science, vol. 12(11), pages 1-15, November.
    8. Chunhua Ju & Qiuyang Gu & Yi Fang & Fuguang Bao, 2020. "Research on User Influence Model Integrating Personality Traits under Strong Connection," Sustainability, MDPI, vol. 12(6), pages 1-15, March.
    9. Karel Hrazdil & Fereshteh Mahmoudian & Jamal A. Nazari, 2021. "Executive personality and sustainability: Do extraverted chief executive officers improve corporate social responsibility?," Corporate Social Responsibility and Environmental Management, John Wiley & Sons, vol. 28(6), pages 1564-1578, November.
    10. Daniel Hoppe & Helen Keller & Felix Horstmann, 2022. "Got Employer Image? How Applicants Choose Their Employer," Corporate Reputation Review, Palgrave Macmillan, vol. 25(2), pages 139-159, May.
    11. Niklas Ziemann, 2022. "You will receive your money next week! Experimental evidence on the role of Future-Time Reference for intertemporal decision-making," CEPA Discussion Papers 56, Center for Economic Policy Analysis.
    12. Sandra C Matz & Jochen I Menges & David J Stillwell & H Andrew Schwartz, 2019. "Predicting individual-level income from Facebook profiles," PLOS ONE, Public Library of Science, vol. 14(3), pages 1-13, March.
    13. Yunhwan Kim & Sunmi Lee, 2021. "Personality of Public Health Organizations’ Instagram Accounts and According Differences in Photos at Content and Pixel Levels," IJERPH, MDPI, vol. 18(8), pages 1-15, April.
    14. Dariusz Zdonek & Karol Król, 2021. "The Impact of Sex and Personality Traits on Social Media Use during the COVID-19 Pandemic in Poland," Sustainability, MDPI, vol. 13(9), pages 1-27, April.
    15. Kühl, Niklas & Schemmer, Max & Goutier, Marc & Satzger, Gerhard, 2022. "Artificial intelligence and machine learning," Publications of Darmstadt Technical University, Institute for Business Studies (BWL) 135656, Darmstadt Technical University, Department of Business Administration, Economics and Law, Institute for Business Studies (BWL).
    16. Yue Han & Theodoros Lappas & Gaurav Sabnis, 2020. "The Importance of Interactions Between Content Characteristics and Creator Characteristics for Studying Virality in Social Media," Information Systems Research, INFORMS, vol. 31(2), pages 576-588, June.
    17. H. Andrew Schwartz & Lyle H. Ungar, 2015. "Data-Driven Content Analysis of Social Media," The ANNALS of the American Academy of Political and Social Science, , vol. 659(1), pages 78-94, May.
    18. Olga Bogolyubova & Polina Panicheva & Yanina Ledovaya & Roman Tikhonov & Bulat Yaminov, 2020. "The Language of Positive Mental Health: Findings From a Sample of Russian Facebook Users," SAGE Open, , vol. 10(2), pages 21582440209, May.
    19. Brencic, Vera & McGee, Andrew, 2023. "Employers’ Demand for Personality Traits and Provision of Incentives," Working Papers 2023-14, University of Alberta, Department of Economics.
    20. Jong Hwan Suh, 2018. "Generating Future-Oriented Energy Policies and Technologies from the Multidisciplinary Group Discussions by Text-Mining-Based Identification of Topics and Experts," Sustainability, MDPI, vol. 10(10), pages 1-33, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:14:y:2022:i:16:p:9939-:d:885794. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.