IDEAS home Printed from https://ideas.repec.org/a/sae/fbbsrw/v12y2023i4p386-402.html
   My bibliography  Save this article

Customer Sentiment Analysis and Prediction of Insurance Products’ Reviews Using Machine Learning Approaches

Author

Listed:
  • Md Shamim Hossain
  • Mst Farjana Rahman

Abstract

The study’s goal is to analyse and predict customer reviews of insurance products using various machine learning techniques. We gathered consumer rating data from the Yelp website and filtered the initial data set to only include insurance reviews. Following cleaning, the filtered summary texts were graded as positive, neutral or negative sentiments, and the AFINN and Valence Aware Dictionary for Sentiment Reasoning (VADER) sentiment algorithms were used to rate those sentiments. Furthermore, the current investigation employs five supervised machine learning approaches to divide customer ratings of insurance companies into three sentiment groups. The results of the current study revealed that the majority of customer reviews for the insurance products were negative, with the average number of words with negative sentiment being higher. In addition, current research discovered that while all of the approaches (decision tree, K Neighbours classifier, support vector machine (SVM), logistic regression and random forest classifier) can correctly classify review text into sentiment class, logistic regression outperforms in high accuracy. We analysed and predicted customer review messages using a variety of machine learning methods, which could help companies better understand how customers respond to their products and services. As a result, companies can learn how to use machine learning methods to better understand the behaviour of their customers.

Suggested Citation

  • Md Shamim Hossain & Mst Farjana Rahman, 2023. "Customer Sentiment Analysis and Prediction of Insurance Products’ Reviews Using Machine Learning Approaches," FIIB Business Review, , vol. 12(4), pages 386-402, December.
  • Handle: RePEc:sae:fbbsrw:v:12:y:2023:i:4:p:386-402
    DOI: 10.1177/23197145221115793
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/23197145221115793
    Download Restriction: no

    File URL: https://libkey.io/10.1177/23197145221115793?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hossain, Md Shamim & Rahman, Mst Farjana, 2022. "Detection of potential customers’ empathy behavior towards customers' reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    2. Zeelenberg, M. & Pieters, R., 2004. "Beyond valence in customer dissatisfaction : A review and new findings on behavioral responses to regret and disappointment in failed services," Other publications TiSEM 7bfb4aa9-cba7-4786-850d-1, Tilburg University, School of Economics and Management.
    3. Ha, Young-Won & Hoch, Stephen J, 1989. "Ambiguity, Processing Strategy, and Advertising-Evidence Interactions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 16(3), pages 354-360, December.
    4. Al-Natour, Sameh & Turetken, Ozgur, 2020. "A comparative assessment of sentiment analysis and star ratings for consumer reviews," International Journal of Information Management, Elsevier, vol. 54(C).
    5. Meek, Stephanie & Wilk, Violetta & Lambert, Claire, 2021. "A big data exploration of the informational and normative influences on the helpfulness of online restaurant reviews," Journal of Business Research, Elsevier, vol. 125(C), pages 354-367.
    6. Thomas Renault, 2020. "Sentiment analysis and machine learning in finance: a comparison of methods and models on one million messages," Digital Finance, Springer, vol. 2(1), pages 1-13, September.
    7. Maraj Rahman Sofi & Iqbal Ahmad Hakim, 2018. "Customer Relationship Management as Tool to Enhance Competitive Effectiveness: Model Revisited," FIIB Business Review, , vol. 7(3), pages 201-215, September.
    8. Geetha, M. & Singha, Pratap & Sinha, Sumedha, 2017. "Relationship between customer sentiment and online customer ratings for hotels - An empirical analysis," Tourism Management, Elsevier, vol. 61(C), pages 43-54.
    9. Wu, Jia-Jhou & Chang, Sue-Ting, 2020. "Exploring customer sentiment regarding online retail services: A topic-based approach," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    10. Pashchenko, Yana & Rahman, Mst Farjana & Hossain, Md Shamim & Uddin, Md Kutub & Islam, Tarannum, 2022. "Emotional and the normative aspects of customers’ reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hossain, Md Shamim & Rahman, Mst Farjana, 2022. "Detection of potential customers’ empathy behavior towards customers' reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    2. Pashchenko, Yana & Rahman, Mst Farjana & Hossain, Md Shamim & Uddin, Md Kutub & Islam, Tarannum, 2022. "Emotional and the normative aspects of customers’ reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    3. Liu, Zhenkun & Zhang, Ying & Abedin, Mohammad Zoynul & Wang, Jianzhou & Yang, Hufang & Gao, Yuyang & Chen, Yinghao, 2024. "Profit-driven fusion framework based on bagging and boosting classifiers for potential purchaser prediction," Journal of Retailing and Consumer Services, Elsevier, vol. 79(C).
    4. Enrique Bigne & Carla Ruiz & Carmen Perez-Cabañero & Antonio Cuenca, 2023. "Are customer star ratings and sentiments aligned? A deep learning study of the customer service experience in tourism destinations," Service Business, Springer;Pan-Pacific Business Association, vol. 17(1), pages 281-314, March.
    5. Nan Yang & Nikolaos Korfiatis & Dimitris Zissis & Konstantina Spanaki, 2024. "Incorporating topic membership in review rating prediction from unstructured data: a gradient boosting approach," Annals of Operations Research, Springer, vol. 339(1), pages 631-662, August.
    6. Yi Feng & Yunqiang Yin & Dujuan Wang & Lalitha Dhamotharan & Joshua Ignatius & Ajay Kumar, 2023. "Diabetic patient review helpfulness: unpacking online drug treatment reviews by text analytics and design science approach," Annals of Operations Research, Springer, vol. 328(1), pages 387-418, September.
    7. Haase, Janina & Wiedmann, Klaus-Peter & Labenz, Franziska, 2022. "Brand hate, rage, anger & co.: Exploring the relevance and characteristics of negative consumer emotions toward brands," Journal of Business Research, Elsevier, vol. 152(C), pages 1-16.
    8. ?ikolaos A. Kyriazis, 2021. "Impacts of Stock Indices, Oil, and Twitter Sentiment on Major Cryptocurrencies during the COVID-19 First Wave," Bulletin of Applied Economics, Risk Market Journals, vol. 8(2), pages 133-146.
    9. Amal Almansour & Reem Alotaibi & Hajar Alharbi, 2022. "Text-rating review discrepancy (TRRD): an integrative review and implications for research," Future Business Journal, Springer, vol. 8(1), pages 1-15, December.
    10. Doris Chenguang Wu & Shiteng Zhong & Richard T R Qiu & Ji Wu, 2022. "Are customer reviews just reviews? Hotel forecasting using sentiment analysis," Tourism Economics, , vol. 28(3), pages 795-816, May.
    11. Moradi, Masoud & Dass, Mayukh & Kumar, Piyush, 2023. "Differential effects of analytical versus emotional rhetorical style on review helpfulness," Journal of Business Research, Elsevier, vol. 154(C).
    12. McColl-Kennedy, Janet R. & Patterson, Paul G. & Smith, Amy K. & Brady, Michael K., 2009. "Customer Rage Episodes: Emotions, Expressions and Behaviors," Journal of Retailing, Elsevier, vol. 85(2), pages 222-237.
    13. Hasan Al-Banna & Izra Berakon, 2024. "From bank to P2P lending: switching intention of SME’s: evidence from Indonesia," Journal of Financial Services Marketing, Palgrave Macmillan, vol. 29(2), pages 568-581, June.
    14. Lee Yen Chaw & Chun Meng Tang, 2019. "Online accommodation booking: what information matters the most to users?," Information Technology & Tourism, Springer, vol. 21(3), pages 369-390, September.
    15. Haithem Zourrig & Jean-Charles Chebat & Roy Toffoli & Alexandra Medina-Borja, 2014. "Customers’ coping with interpersonal conflicts in intra and inter-cultural service encounters," AMS Review, Springer;Academy of Marketing Science, vol. 4(1), pages 21-31, June.
    16. Mazzotta, Stefano, 2022. "Immigration narrative sentiment from TV news and the stock market," Journal of Behavioral and Experimental Finance, Elsevier, vol. 34(C).
    17. Jihyeong Son & Changhyun Nam & Sonali Diddi, 2022. "Emotion or Information: What Makes Consumers Communicate about Sustainable Apparel Products on Social Media?," Sustainability, MDPI, vol. 14(5), pages 1-13, March.
    18. Ahani, Ali & Nilashi, Mehrbakhsh & Yadegaridehkordi, Elaheh & Sanzogni, Louis & Tarik, A. Rashid & Knox, Kathy & Samad, Sarminah & Ibrahim, Othman, 2019. "Revealing customers’ satisfaction and preferences through online review analysis: The case of Canary Islands hotels," Journal of Retailing and Consumer Services, Elsevier, vol. 51(C), pages 331-343.
    19. Xue, Lan & Leung, Xi Y. & Ma, Shihan (David), 2022. "What makes a good “guest”: Evidence from Airbnb hosts' reviews," Annals of Tourism Research, Elsevier, vol. 95(C).
    20. Wang, Saerom & Kirillova, Ksenia & Lehto, Xinran, 2017. "Reconciling unsatisfying tourism experiences: Message type effectiveness and the role of counterfactual thinking," Tourism Management, Elsevier, vol. 60(C), pages 233-243.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:fbbsrw:v:12:y:2023:i:4:p:386-402. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.