IDEAS home Printed from https://ideas.repec.org/a/spr/jcsosc/v8y2025i3d10.1007_s42001-025-00382-y.html
   My bibliography  Save this article

‘Slightly disappointing’ vs. ‘worst sh** ever’: tackling cultural differences in negative sentiment expressions in AI-based sentiment analysis

Author

Listed:
  • Franziska Sofia Hafner

    (American University
    University of Oxford)

  • Lena Hafner

    (University of Cambridge)

  • Roberto Corizzo

    (American University)

Abstract

Advertisers, politicians, and social scientists alike have an interest in the current zeitgeist. With people expressing their sentiments in online comments, the Internet has become a great source for ‘reading’ the zeitgeist via artificial intelligence-based sentiment analysis (SA). At this, negative sentiments are of special concern. They can serve as early indicators for events that require action, such as dropping customer satisfaction, discontent amongst potential voters, or a threat of social unrest. However, due to cultural differences in how negative sentiments are expressed, conventional SA methods typically classify such texts with higher accuracy for some ethnicities compared to others. In this paper, we demonstrate this using a large real-world corpus of Google Maps reviews. Across eight ethnic groups, linguistic patterns vary more starkly in negative (1 star) reviews than in neutral (2–4 star) and positive (5 star) reviews. Consequently, ethnicity-blind SA methods ‘struggle’ to classify negative reviews correctly. To mitigate this problem, we propose a novel SA method, based on balanced training and subsequent ethnicity-conscious fine-tuning. Our approach is simultaneously able to mitigate bias and enhance overall model performance. Thus, we hope to contribute to a more equal appreciation of negative sentiments of ethnically diverse customer-, voter-, or research populations, and, consequently, a more nuanced approximation of the overall zeitgeist.

Suggested Citation

  • Franziska Sofia Hafner & Lena Hafner & Roberto Corizzo, 2025. "‘Slightly disappointing’ vs. ‘worst sh** ever’: tackling cultural differences in negative sentiment expressions in AI-based sentiment analysis," Journal of Computational Social Science, Springer, vol. 8(3), pages 1-31, August.
  • Handle: RePEc:spr:jcsosc:v:8:y:2025:i:3:d:10.1007_s42001-025-00382-y
    DOI: 10.1007/s42001-025-00382-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s42001-025-00382-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s42001-025-00382-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ryuichi Saito & Shinichiro Haruyama, 2023. "Estimating time-series changes in social sentiment @Twitter in U.S. metropolises during the COVID-19 pandemic," Journal of Computational Social Science, Springer, vol. 6(1), pages 359-388, April.
    2. Valentin Hofmann & Pratyusha Ria Kalluri & Dan Jurafsky & Sharese King, 2024. "AI generates covertly racist decisions about people based on their dialect," Nature, Nature, vol. 633(8028), pages 147-154, September.
    3. Alim Al Ayub Ahmed & Sugandha Agarwal & IMade Gede Ariestova Kurniawan & Samuel P. D. Anantadjaya & Chitra Krishnan, 2022. "Business boosting through sentiment analysis using Artificial Intelligence approach," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 13(1), pages 699-709, March.
    4. Benedikt M. Brand & Cristopher Siegfried Kopplin & Theresa Maria Rausch, 2022. "Cultural differences in processing online customer reviews: holistic versus analytic thinkers," Electronic Markets, Springer;IIM University of St. Gallen, vol. 32(3), pages 1039-1060, September.
    5. Georgiadou, Elena & Angelopoulos, Spyros & Drake, Helen, 2020. "Big data analytics and international negotiations: Sentiment analysis of Brexit negotiating outcomes," International Journal of Information Management, Elsevier, vol. 51(C).
    6. David Rozado & Musa al-Gharbi, 2022. "Using word embeddings to probe sentiment associations of politically loaded terms in news and opinion articles from news media outlets," Journal of Computational Social Science, Springer, vol. 5(1), pages 427-448, May.
    7. Fong, John & Burton, Suzan, 2008. "A cross-cultural comparison of electronic word-of-mouth and country-of-origin effects," Journal of Business Research, Elsevier, vol. 61(3), pages 233-242, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kee-Young Kwahk & Byoungsoo Kim, 2017. "Effects of social media on consumers’ purchase decisions: evidence from Taobao," Service Business, Springer;Pan-Pacific Business Association, vol. 11(4), pages 803-829, December.
    2. Wang, Kai-Yu & Ting, I-Hsien & Wu, Hui-Ju, 2013. "Discovering interest groups for marketing in virtual communities: An integrated approach," Journal of Business Research, Elsevier, vol. 66(9), pages 1360-1366.
    3. Sheema Liza Idris & Masurah Mohamad, 2023. "A Study on Sentiment Analysis on Airline Quality Services: A Conceptual Paper," Information Management and Business Review, AMH International, vol. 15(4), pages 564-576.
    4. Kim, Junyong & Gupta, Pranjal, 2012. "Emotional expressions in online user reviews: How they influence consumers' product evaluations," Journal of Business Research, Elsevier, vol. 65(7), pages 985-992.
    5. Rizzo, Cristian & Baima, Gabriele & Janovská, Kamila & Bresciani, Stefano, 2025. "Navigating the uncertainty path of virtual influencers: Empirical evidence through a cultural lens," Technological Forecasting and Social Change, Elsevier, vol. 210(C).
    6. Diksha Shukla & Sanjay K. Dwivedi, 2025. "Sentiment analysis versus aspect-based sentiment analysis versus emotion analysis from text: a comparative study," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 16(2), pages 512-531, February.
    7. Anisha Singh & P. K. Kapur & V. B. Singh, 2024. "Developing classifiers by considering sentiment analysis of reported bugs for priority prediction," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 15(5), pages 1888-1899, May.
    8. Varsha Sehgal & Naval Garg & Jagvinder Singh, 2023. "Impact of sustainability performance & reporting on a firm’s reputation," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 14(1), pages 228-240, February.
    9. Obal, Michael & Kunz, Werner, 2016. "Cross-cultural differences in uses of online experts," Journal of Business Research, Elsevier, vol. 69(3), pages 1148-1156.
    10. Erkan Gunes & Christoffer Koch Florczak, 2025. "Replacing or enhancing the human coder? Multiclass classification of policy documents with large language models," Journal of Computational Social Science, Springer, vol. 8(2), pages 1-20, May.
    11. Elliott, Greg & Tam, Charles Chin Chiu, 2014. "Does culture matter to Chinese consumers? Empirical evidence," Australasian marketing journal, Elsevier, vol. 22(4), pages 314-324.
    12. Kayeser Fatima, Johra & Khan, Md Irfanuzzaman & Bahmannia, Somayeh & Chatrath, Sarvjeet Kaur & Dale, Naomi F. & Johns, Raechel, 2024. "Rapport with a chatbot? The underlying role of anthropomorphism in socio-cognitive perceptions of rapport and e-word of mouth," Journal of Retailing and Consumer Services, Elsevier, vol. 77(C).
    13. K. Pooja & Pallavi Upadhyaya, 2024. "What makes an online review credible? A systematic review of the literature and future research directions," Management Review Quarterly, Springer, vol. 74(2), pages 627-659, June.
    14. Kim, Taeyong & Hwang, Seungsoo & Kim, Minkyung, 2022. "Text analysis of online customer reviews for products in the FCB quadrants: Procedure, outcomes, and implications," Journal of Business Research, Elsevier, vol. 150(C), pages 676-689.
    15. Kasabov, Edward, 2016. "Unknown, surprising, and economically significant: The realities of electronic word of mouth in Chinese social networking sites," Journal of Business Research, Elsevier, vol. 69(2), pages 642-652.
    16. Meihua Zuo & Spyros Angelopoulos & Zhouyang Liang & Carol X. J. Ou, 2023. "Blazing the Trail: Considering Browsing Path Dependence in Online Service Response Strategy," Information Systems Frontiers, Springer, vol. 25(4), pages 1605-1619, August.
    17. King, Robert Allen & Racherla, Pradeep & Bush, Victoria D., 2014. "What We Know and Don't Know About Online Word-of-Mouth: A Review and Synthesis of the Literature," Journal of Interactive Marketing, Elsevier, vol. 28(3), pages 167-183.
    18. Raghav Gupta & Md Mahadi Hasan & Syed Zahurul Islam & Tahmina Yasmin & Jasim Uddin, 2023. "Evaluating the Brexit and COVID-19’s influence on the UK economy: A data analysis," PLOS ONE, Public Library of Science, vol. 18(6), pages 1-33, June.
    19. Shavitt, Sharon & Barnes, Aaron J., 2020. "Culture and the Consumer Journey," Journal of Retailing, Elsevier, vol. 96(1), pages 40-54.
    20. Harrison, Robert L., 2013. "Using mixed methods designs in the Journal of Business Research, 1990–2010," Journal of Business Research, Elsevier, vol. 66(11), pages 2153-2162.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:jcsosc:v:8:y:2025:i:3:d:10.1007_s42001-025-00382-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.