IDEAS home Printed from https://ideas.repec.org/a/gam/jdataj/v8y2023i12p180-d1289559.html
   My bibliography  Save this article

Public Perception of ChatGPT and Transfer Learning for Tweets Sentiment Analysis Using Wolfram Mathematica

Author

Listed:
  • Yankang Su

    (Pioneer Academics, 101 Greenwood Ave, Ste 170, Jenkintown, PA 19046, USA)

  • Zbigniew J. Kabala

    (Department of Civil & Environmental Engineering, Duke University, Durham, NC 27708, USA)

Abstract

Understanding public opinion on ChatGPT is crucial for recognizing its strengths and areas of concern. By utilizing natural language processing (NLP), this study delves into tweets regarding ChatGPT to determine temporal patterns, content features, and topic modeling and perform a sentiment analysis. Analyzing a dataset of 500,000 tweets, our research shifts from conventional data science tools like Python and R to exploit Wolfram Mathematica’s robust capabilities. Additionally, with the aim of solving the problem of ignoring semantic information in the LDA model feature extraction, a synergistic methodology entwining LDA, GloVe embeddings, and K-Nearest Neighbors (KNN) clustering is proposed to categorize topics within ChatGPT-related tweets. This comprehensive strategy ensures semantic, syntactic, and topical congruence within classified groups by utilizing the strengths of probabilistic modeling, semantic embeddings, and similarity-based clustering. While built-in sentiment classifiers often fall short in accuracy, we introduce four transfer learning techniques from the Wolfram Neural Net Repository to address this gap. Two of these techniques involve transferring static word embeddings, “GloVe” and “ConceptNet”, which are further processed using an LSTM layer. The remaining techniques center on fine-tuning pre-trained models using scantily annotated data; one refines embeddings from language models (ELMo), while the other fine-tunes bidirectional encoder representations from transformers (BERT). Our experiments on the dataset underscore the effectiveness of the four methods for the sentiment analysis of tweets. This investigation augments our comprehension of user sentiment towards ChatGPT and emphasizes the continued significance of exploration in this domain. Furthermore, this work serves as a pivotal reference for scholars who are accustomed to using Wolfram Mathematica in other research domains, aiding their efforts in text analytics on social media platforms.

Suggested Citation

  • Yankang Su & Zbigniew J. Kabala, 2023. "Public Perception of ChatGPT and Transfer Learning for Tweets Sentiment Analysis Using Wolfram Mathematica," Data, MDPI, vol. 8(12), pages 1-27, November.
  • Handle: RePEc:gam:jdataj:v:8:y:2023:i:12:p:180-:d:1289559
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2306-5729/8/12/180/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2306-5729/8/12/180/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mike Thelwall & Kevan Buckley & Georgios Paltoglou, 2012. "Sentiment strength detection for the social web," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 63(1), pages 163-173, January.
    2. Charlotte Roe & Madison Lowe & Benjamin Williams & Clare Miller, 2021. "Public Perception of SARS-CoV-2 Vaccinations on Social Media: Questionnaire and Sentiment Analysis," IJERPH, MDPI, vol. 18(24), pages 1-21, December.
    3. Mike Thelwall & Kevan Buckley & Georgios Paltoglou, 2012. "Sentiment strength detection for the social web," Journal of the American Society for Information Science and Technology, Association for Information Science & Technology, vol. 63(1), pages 163-173, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Agrawal, Shiv Ratan & Mittal, Divya, 2022. "Optimizing customer engagement content strategy in retail and E-tail: Available on online product review videos," Journal of Retailing and Consumer Services, Elsevier, vol. 67(C).
    2. Young Bin Kim & Sang Hyeok Lee & Shin Jin Kang & Myung Jin Choi & Jung Lee & Chang Hun Kim, 2015. "Virtual World Currency Value Fluctuation Prediction System Based on User Sentiment Analysis," PLOS ONE, Public Library of Science, vol. 10(8), pages 1-18, August.
    3. Ping-Yu Hsu & Hong-Tsuen Lei & Shih-Hsiang Huang & Teng Hao Liao & Yao-Chung Lo & Chin-Chun Lo, 2019. "Effects of sentiment on recommendations in social network," Electronic Markets, Springer;IIM University of St. Gallen, vol. 29(2), pages 253-262, June.
    4. Luis J. Callarisa-Fiol & Miguel Ángel Moliner-Tena & Rosa Rodríguez-Artola & Javier Sánchez-García, 2023. "Entrepreneurship innovation using social robots in tourism: a social listening study," Review of Managerial Science, Springer, vol. 17(8), pages 2945-2971, November.
    5. Annamalai, Balamurugan & Yoshida, Masayuki & Varshney, Sanjeev & Pathak, Atul Arun & Venugopal, Pingali, 2021. "Social media content strategy for sport clubs to drive fan engagement," Journal of Retailing and Consumer Services, Elsevier, vol. 62(C).
    6. Simon Albrecht & Bernhard Lutz & Dirk Neumann, 2020. "The behavior of blockchain ventures on Twitter as a determinant for funding success," Electronic Markets, Springer;IIM University of St. Gallen, vol. 30(2), pages 241-257, June.
    7. Yawar Abbas & M. S. I. Malik, 2023. "Defective products identification framework using online reviews," Electronic Commerce Research, Springer, vol. 23(2), pages 899-920, June.
    8. Xiong, Xi & Li, Yuanyuan & Qiao, Shaojie & Han, Nan & Wu, Yue & Peng, Jing & Li, Binyong, 2018. "An emotional contagion model for heterogeneous social media with multiple behaviors," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 185-202.
    9. Ghasem Javadi & Mohammad Taleai, 2020. "Integration of User Generated Geo-contents and Official Data to Assess Quality of Life in Intra-national Level," Social Indicators Research: An International and Interdisciplinary Journal for Quality-of-Life Measurement, Springer, vol. 152(1), pages 205-235, November.
    10. José Luis Ortega, 2022. "Classification and analysis of PubPeer comments: How a web journal club is used," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 73(5), pages 655-670, May.
    11. Wouter van der Schors & Marco Varkevisser, 2023. "Does Enforcement of the Cartel Prohibition in Healthcare Reflect Public and Political Attitudes Towards Competition? A Longitudinal Study From the Netherlands," Journal of Competition Law and Economics, Oxford University Press, vol. 19(2), pages 193-219.
    12. Vaughan, Liwen & Yang, Rongbin, 2013. "Web traffic and organization performance measures: Relationships and data sources examined," Journal of Informetrics, Elsevier, vol. 7(3), pages 699-711.
    13. Jifeng Mu & Jonathan Zhang & Abhishek Borah & Jiayin Qi, 2022. "Creative Appeals in Firm-Generated Content and Product Performance," Information Systems Research, INFORMS, vol. 33(1), pages 18-42, March.
    14. Sandeepa Kannangara & Wayne Wobcke, 2022. "Determining political interests of issue-motivated groups on social media: joint topic models for issues, sentiment and stance," Journal of Computational Social Science, Springer, vol. 5(1), pages 811-840, May.
    15. Victoria Tur-Viñes & Araceli Castelló-Martínez, 2019. "Commenting on Top Spanish YouTubers: “No Comment”," Social Sciences, MDPI, vol. 8(10), pages 1-14, September.
    16. Miklos Sebők & Zoltán Kacsuk & Ákos Máté, 2022. "The (real) need for a human touch: testing a human–machine hybrid topic classification workflow on a New York Times corpus," Quality & Quantity: International Journal of Methodology, Springer, vol. 56(5), pages 3621-3643, October.
    17. Christopher Ifeanyi Eke & Azah Anir Norman & Liyana Shuib, 2021. "Multi-feature fusion framework for sarcasm identification on twitter data: A machine learning based approach," PLOS ONE, Public Library of Science, vol. 16(6), pages 1-32, June.
    18. Stephen Nabareseh & Eric Afful-Dadzie & Petr Klimek, 2018. "Leveraging Fine-Grained Sentiment Analysis for Competitivity," Journal of Information & Knowledge Management (JIKM), World Scientific Publishing Co. Pte. Ltd., vol. 17(02), pages 1-20, June.
    19. Singh, Amit & Jenamani, Mamata & Thakkar, Jitesh J. & Rana, Nripendra P., 2021. "Propagation of online consumer perceived negativity: Quantifying the effect of supply chain underperformance on passenger car sales," Journal of Business Research, Elsevier, vol. 132(C), pages 102-114.
    20. Roser Beneito-Montagut, 2017. "Emotions, Everyday Life, and the Social Web: Age, Gender, and Social Web Engagement Effects on Online Emotional Expression," Sociological Research Online, , vol. 22(4), pages 87-104, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jdataj:v:8:y:2023:i:12:p:180-:d:1289559. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.