IDEAS home Printed from https://ideas.repec.org/a/sae/fbbsrw/v12y2023i4p386-402.html
   My bibliography  Save this article

Customer Sentiment Analysis and Prediction of Insurance Products’ Reviews Using Machine Learning Approaches

Author

Listed:
  • Md Shamim Hossain
  • Mst Farjana Rahman

Abstract

The study’s goal is to analyse and predict customer reviews of insurance products using various machine learning techniques. We gathered consumer rating data from the Yelp website and filtered the initial data set to only include insurance reviews. Following cleaning, the filtered summary texts were graded as positive, neutral or negative sentiments, and the AFINN and Valence Aware Dictionary for Sentiment Reasoning (VADER) sentiment algorithms were used to rate those sentiments. Furthermore, the current investigation employs five supervised machine learning approaches to divide customer ratings of insurance companies into three sentiment groups. The results of the current study revealed that the majority of customer reviews for the insurance products were negative, with the average number of words with negative sentiment being higher. In addition, current research discovered that while all of the approaches (decision tree, K Neighbours classifier, support vector machine (SVM), logistic regression and random forest classifier) can correctly classify review text into sentiment class, logistic regression outperforms in high accuracy. We analysed and predicted customer review messages using a variety of machine learning methods, which could help companies better understand how customers respond to their products and services. As a result, companies can learn how to use machine learning methods to better understand the behaviour of their customers.

Suggested Citation

  • Md Shamim Hossain & Mst Farjana Rahman, 2023. "Customer Sentiment Analysis and Prediction of Insurance Products’ Reviews Using Machine Learning Approaches," FIIB Business Review, , vol. 12(4), pages 386-402, December.
  • Handle: RePEc:sae:fbbsrw:v:12:y:2023:i:4:p:386-402
    DOI: 10.1177/23197145221115793
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/23197145221115793
    Download Restriction: no

    File URL: https://libkey.io/10.1177/23197145221115793?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hossain, Md Shamim & Rahman, Mst Farjana, 2022. "Detection of potential customers’ empathy behavior towards customers' reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    2. Geetha, M. & Singha, Pratap & Sinha, Sumedha, 2017. "Relationship between customer sentiment and online customer ratings for hotels - An empirical analysis," Tourism Management, Elsevier, vol. 61(C), pages 43-54.
    3. Thomas Renault, 2020. "Sentiment analysis and machine learning in finance: a comparison of methods and models on one million messages," Digital Finance, Springer, vol. 2(1), pages 1-13, September.
    4. Zeelenberg, M. & Pieters, R., 2004. "Beyond valence in customer dissatisfaction : A review and new findings on behavioral responses to regret and disappointment in failed services," Other publications TiSEM 7bfb4aa9-cba7-4786-850d-1, Tilburg University, School of Economics and Management.
    5. Wu, Jia-Jhou & Chang, Sue-Ting, 2020. "Exploring customer sentiment regarding online retail services: A topic-based approach," Journal of Retailing and Consumer Services, Elsevier, vol. 55(C).
    6. Ha, Young-Won & Hoch, Stephen J, 1989. "Ambiguity, Processing Strategy, and Advertising-Evidence Interactions," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 16(3), pages 354-360, December.
    7. Al-Natour, Sameh & Turetken, Ozgur, 2020. "A comparative assessment of sentiment analysis and star ratings for consumer reviews," International Journal of Information Management, Elsevier, vol. 54(C).
    8. Meek, Stephanie & Wilk, Violetta & Lambert, Claire, 2021. "A big data exploration of the informational and normative influences on the helpfulness of online restaurant reviews," Journal of Business Research, Elsevier, vol. 125(C), pages 354-367.
    9. Maraj Rahman Sofi & Iqbal Ahmad Hakim, 2018. "Customer Relationship Management as Tool to Enhance Competitive Effectiveness: Model Revisited," FIIB Business Review, , vol. 7(3), pages 201-215, September.
    10. Pashchenko, Yana & Rahman, Mst Farjana & Hossain, Md Shamim & Uddin, Md Kutub & Islam, Tarannum, 2022. "Emotional and the normative aspects of customers’ reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pashchenko, Yana & Rahman, Mst Farjana & Hossain, Md Shamim & Uddin, Md Kutub & Islam, Tarannum, 2022. "Emotional and the normative aspects of customers’ reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    2. Hossain, Md Shamim & Rahman, Mst Farjana, 2022. "Detection of potential customers’ empathy behavior towards customers' reviews," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    3. Yi Feng & Yunqiang Yin & Dujuan Wang & Lalitha Dhamotharan & Joshua Ignatius & Ajay Kumar, 2023. "Diabetic patient review helpfulness: unpacking online drug treatment reviews by text analytics and design science approach," Annals of Operations Research, Springer, vol. 328(1), pages 387-418, September.
    4. Enrique Bigne & Carla Ruiz & Carmen Perez-Cabañero & Antonio Cuenca, 2023. "Are customer star ratings and sentiments aligned? A deep learning study of the customer service experience in tourism destinations," Service Business, Springer;Pan-Pacific Business Association, vol. 17(1), pages 281-314, March.
    5. Haase, Janina & Wiedmann, Klaus-Peter & Labenz, Franziska, 2022. "Brand hate, rage, anger & co.: Exploring the relevance and characteristics of negative consumer emotions toward brands," Journal of Business Research, Elsevier, vol. 152(C), pages 1-16.
    6. ?ikolaos A. Kyriazis, 2021. "Impacts of Stock Indices, Oil, and Twitter Sentiment on Major Cryptocurrencies during the COVID-19 First Wave," Bulletin of Applied Economics, Risk Market Journals, vol. 8(2), pages 133-146.
    7. Sebastian Molinillo & Francisco Rejón-Guardia & Rafael Anaya-Sánchez, 2023. "Exploring the antecedents of customers’ willingness to use service robots in restaurants," Service Business, Springer;Pan-Pacific Business Association, vol. 17(1), pages 167-193, March.
    8. Cambra-Fierro, Jesus & Melero, Iguacel & Sese, F. Javier, 2015. "Managing Complaints to Improve Customer Profitability," Journal of Retailing, Elsevier, vol. 91(1), pages 109-124.
    9. Amal Almansour & Reem Alotaibi & Hajar Alharbi, 2022. "Text-rating review discrepancy (TRRD): an integrative review and implications for research," Future Business Journal, Springer, vol. 8(1), pages 1-15, December.
    10. Doris Chenguang Wu & Shiteng Zhong & Richard T R Qiu & Ji Wu, 2022. "Are customer reviews just reviews? Hotel forecasting using sentiment analysis," Tourism Economics, , vol. 28(3), pages 795-816, May.
    11. Nur’Hidayah Che Ahmat Author_Email: nurhidayahcheahmat@gmail.com & Salleh Mohd Radzi & Mohd Salehuddin Mohd Zahari & Rosmaliza Muhammad, 2011. "The Effect Of Factors Influencing The Perception Of Price Fairness Towards Customer Response Behaviors," 2nd International Conference on Business and Economic Research (2nd ICBER 2011) Proceeding 2011-169, Conference Master Resources.
    12. Béatrice BOULU-RESHEF & Catherine BRUNEAU & Maxime NICOLAS & Thomas RENAULT, 2022. "An Experimental Analysis of Investor Sentiment," LEO Working Papers / DR LEO 2940, Orleans Economics Laboratory / Laboratoire d'Economie d'Orleans (LEO), University of Orleans.
    13. Moradi, Masoud & Dass, Mayukh & Kumar, Piyush, 2023. "Differential effects of analytical versus emotional rhetorical style on review helpfulness," Journal of Business Research, Elsevier, vol. 154(C).
    14. Ivan Barreda-Tarrazona & Ainhoa Jaramillo-Gutierrez & Daniel Navarro-Martinez & Gerardo Sabater-Grande, 2014. "The role of forgone opportunities in decision making under risk," Journal of Risk and Uncertainty, Springer, vol. 49(2), pages 167-188, October.
    15. Lee, K.M.C. & Kraussl, R.G.W. & Paas, L.J., 2009. "The effect of anticipated and experienced regret and pride on investors' future selling decisions," Serie Research Memoranda 0057, VU University Amsterdam, Faculty of Economics, Business Administration and Econometrics.
    16. McColl-Kennedy, Janet R. & Patterson, Paul G. & Smith, Amy K. & Brady, Michael K., 2009. "Customer Rage Episodes: Emotions, Expressions and Behaviors," Journal of Retailing, Elsevier, vol. 85(2), pages 222-237.
    17. Davies, Antony & Cline, Thomas W., 2005. "A consumer behavior approach to modeling monopolistic competition," Journal of Economic Psychology, Elsevier, vol. 26(6), pages 797-826, December.
    18. Lee Yen Chaw & Chun Meng Tang, 2019. "Online accommodation booking: what information matters the most to users?," Information Technology & Tourism, Springer, vol. 21(3), pages 369-390, September.
    19. Abhishek Tandon & Aakash Aakash & Anu G. Aggarwal & P. K. Kapur, 0. "Analyzing the impact of review recency on helpfulness through econometric modeling," International Journal of System Assurance Engineering and Management, Springer;The Society for Reliability, Engineering Quality and Operations Management (SREQOM),India, and Division of Operation and Maintenance, Lulea University of Technology, Sweden, vol. 0, pages 1-8.
    20. Haithem Zourrig & Jean-Charles Chebat & Roy Toffoli & Alexandra Medina-Borja, 2014. "Customers’ coping with interpersonal conflicts in intra and inter-cultural service encounters," AMS Review, Springer;Academy of Marketing Science, vol. 4(1), pages 21-31, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:fbbsrw:v:12:y:2023:i:4:p:386-402. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.