IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2602.15312.html

Extracting Consumer Insight from Text: A Large Language Model Approach to Emotion and Evaluation Measurement

Author

Listed:
  • Stephan Ludwig
  • Peter J. Danaher
  • Xiaohao Yang
  • Yu-Ting Lin
  • Ehsan Abedin
  • Dhruv Grewal
  • Lan Du

Abstract

Accurately measuring consumer emotions and evaluations from unstructured text remains a core challenge for marketing research and practice. This study introduces the Linguistic eXtractor (LX), a fine-tuned, large language model trained on consumer-authored text that also has been labeled with consumers' self-reported ratings of 16 consumption-related emotions and four evaluation constructs: trust, commitment, recommendation, and sentiment. LX consistently outperforms leading models, including GPT-4 Turbo, RoBERTa, and DeepSeek, achieving 81% macro-F1 accuracy on open-ended survey responses and greater than 95% accuracy on third-party-annotated Amazon and Yelp reviews. An application of LX to online retail data, using seemingly unrelated regression, affirms that review-expressed emotions predict product ratings, which in turn predict purchase behavior. Most emotional effects are mediated by product ratings, though some emotions, such as discontent and peacefulness, influence purchase directly, indicating that emotional tone provides meaningful signals beyond star ratings. To support its use, a no-code, cost-free, LX web application is available, enabling scalable analyses of consumer-authored text. In establishing a new methodological foundation for consumer perception measurement, this research demonstrates new methods for leveraging large language models to advance marketing research and practice, thereby achieving validated detection of marketing constructs from consumer data.

Suggested Citation

  • Stephan Ludwig & Peter J. Danaher & Xiaohao Yang & Yu-Ting Lin & Ehsan Abedin & Dhruv Grewal & Lan Du, 2026. "Extracting Consumer Insight from Text: A Large Language Model Approach to Emotion and Evaluation Measurement," Papers 2602.15312, arXiv.org.
  • Handle: RePEc:arx:papers:2602.15312
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2602.15312
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Sunil Gupta & Valarie Zeithaml, 2006. "Customer Metrics and Their Impact on Financial Performance," Marketing Science, INFORMS, vol. 25(6), pages 718-739, 11-12.
    2. Meysam Alizadeh & Maël Kubli & Zeynab Samei & Shirin Dehghani & Mohammadmasiha Zahedivafa & Juan D. Bermeo & Maria Korobeynikova & Fabrizio Gilardi, 2025. "Open-source LLMs for text annotation: a practical guide for model setting and fine-tuning," Journal of Computational Social Science, Springer, vol. 8(1), pages 1-25, February.
    3. Anne-Madeleine Kranzbühler & Alfred Zerres & Mirella H. P. Kleijnen & Peeter W. J. Verlegh, 2020. "Correction to: Beyond valence: a meta-analysis of discrete emotions in firm-customer encounters," Journal of the Academy of Marketing Science, Springer, vol. 48(6), pages 1254-1256, November.
    4. Anne-Madeleine Kranzbühler & Alfred Zerres & Mirella H. P. Kleijnen & Peeter W. J. Verlegh, 2020. "Beyond valence: a meta-analysis of discrete emotions in firm-customer encounters," Journal of the Academy of Marketing Science, Springer, vol. 48(3), pages 478-498, May.
    5. Richins, Marsha L, 1997. "Measuring Emotions in the Consumption Experience," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 24(2), pages 127-146, September.
    6. Dinesh Puranam & Vrinda Kadiyali & Vishal Narayan, 2021. "The Impact of Increase in Minimum Wages on Consumer Perceptions of Service: A Transformer Model of Online Restaurant Reviews," Marketing Science, INFORMS, vol. 40(5), pages 985-1004, September.
    7. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    8. Shyam Gopinath & Jacquelyn S. Thomas & Lakshman Krishnamurthi, 2014. "Investigating the Relationship Between the Content of Online Word of Mouth, Advertising, and Brand Performance," Marketing Science, INFORMS, vol. 33(2), pages 241-258, March.
    9. Prasad Vana & Anja Lambrecht, 2021. "The Effect of Individual Online Reviews on Purchase Likelihood," Marketing Science, INFORMS, vol. 40(4), pages 708-730, July.
    10. Pradeep Chintagunta & Dominique M. Hanssens & John R. Hauser, 2016. "Editorial—Marketing Science and Big Data," Marketing Science, INFORMS, vol. 35(3), pages 341-342, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qi, Ji (Miracle) & Wang, Sijun & Lindsey Hall, Kristina K., 2023. "Bridging employee engagement and customer engagement in a service context," Journal of Business Research, Elsevier, vol. 160(C).
    2. Soderlund, Magnus & Oikarinen, Eeva-Liisa & Tan, Teck Ming, 2021. "The happy virtual agent and its impact on the human customer in the service encounter," Journal of Retailing and Consumer Services, Elsevier, vol. 59(C).
    3. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    4. Uttara Ananthakrishnan & Davide Proserpio & Siddhartha Sharma, 2023. "I Hear You: Does Quality Improve with Customer Voice?," Marketing Science, INFORMS, vol. 42(6), pages 1143-1161, November.
    5. Xiao Liu & Param Vir Singh & Kannan Srinivasan, 2016. "A Structured Analysis of Unstructured Big Data by Leveraging Cloud Computing," Marketing Science, INFORMS, vol. 35(3), pages 363-388, May.
    6. Ruth N. Bolton & Anders Gustafsson & Crina O. Tarasi & Lars Witell, 2022. "Designing satisfying service encounters: website versus store touchpoints," Journal of the Academy of Marketing Science, Springer, vol. 50(1), pages 85-107, January.
    7. Tian, Yu-Xin & Zhang, Chuan, 2023. "An end-to-end deep learning model for solving data-driven newsvendor problem with accessibility to textual review data," International Journal of Production Economics, Elsevier, vol. 265(C).
    8. Zhai, Mengfan & Wang, Xinyue & Zhao, Xijie, 2024. "The importance of online customer reviews characteristics on remanufactured product sales: Evidence from the mobile phone market on Amazon.com," Journal of Retailing and Consumer Services, Elsevier, vol. 77(C).
    9. Jang, Seongsoo & Chung, Jaihak & Rao, Vithala R., 2021. "The importance of functional and emotional content in online consumer reviews for product sales: Evidence from the mobile gaming market," Journal of Business Research, Elsevier, vol. 130(C), pages 583-593.
    10. Liu, Angela Xia & Xie, Ying & Zhang, Jurui, 2019. "It's Not Just What You Say, But How You Say It: The Effect of Language Style Matching on Perceived Quality of Consumer Reviews," Journal of Interactive Marketing, Elsevier, vol. 46(C), pages 70-86.
    11. Herrando, Carolina & Jiménez-Martínez, Julio & Martín-De Hoyos, María José & Constantinides, Efthymios, 2022. "Emotional contagion triggered by online consumer reviews: Evidence from a neuroscience study," Journal of Retailing and Consumer Services, Elsevier, vol. 67(C).
    12. Yinxing Li & Nobuhiko Terui, 2026. "Social media effects on multi-generational diffusion of information technology products," Electronic Commerce Research, Springer, vol. 26(2), pages 1461-1488, April.
    13. Venkatesh Shankar & Pablo Azar & Matthew Fuller, 2008. "—: A Multicategory Brand Equity Model and Its Application at Allstate," Marketing Science, INFORMS, vol. 27(4), pages 567-584, 07-08.
    14. Polo, Yolanda & Sese, F. Javier & Verhoef, Peter C., 2011. "The Effect of Pricing and Advertising on Customer Retention in a Liberalizing Market," Journal of Interactive Marketing, Elsevier, vol. 25(4), pages 201-214.
    15. Garaus, Marion & Wagner, Udo, 2016. "Retail shopper confusion: Conceptualization, scale development, and consequences," Journal of Business Research, Elsevier, vol. 69(9), pages 3459-3467.
    16. Gal-Tzur, Ayelet & Grant-Muller, Susan M. & Kuflik, Tsvi & Minkov, Einat & Nocera, Silvio & Shoor, Itay, 2014. "The potential of social media in delivering transport policy goals," Transport Policy, Elsevier, vol. 32(C), pages 115-123.
    17. Angulo-Ruiz, Fernando & Pergelova, Albena & Cheben, Juraj & Angulo-Altamirano, Eladio, 2016. "A cross-country study of marketing effectiveness in high-credence services," Journal of Business Research, Elsevier, vol. 69(9), pages 3636-3644.
    18. Yu Ding & Wayne S. DeSarbo & Dominique M. Hanssens & Kamel Jedidi & John G. Lynch & Donald R. Lehmann, 2020. "The past, present, and future of measurement and methods in marketing analysis," Marketing Letters, Springer, vol. 31(2), pages 175-186, September.
    19. Lucia Reisch & Clive L Spash & Sabine Bietz, 2008. "Sustainable Consumption and Mass Communication: A German Experiment," Socio-Economics and the Environment in Discussion (SEED) Working Paper Series 2008-12, CSIRO Sustainable Ecosystems.
    20. Heyes, Anthony & Kapur, Sandeep, 2012. "Angry customers, e-word-of-mouth and incentives for quality provision," Journal of Economic Behavior & Organization, Elsevier, vol. 84(3), pages 813-828.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2602.15312. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.