IDEAS home Printed from https://ideas.repec.org/p/cwl/cwldpp/2176.html
   My bibliography  Save this paper

Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection

Author

Listed:

Abstract

The authors address two novel and significant challenges in using online text reviews to obtain attribute level ratings. First, they introduce the problem of inferring attribute level sentiment from text data to the marketing literature and develop a deep learning model to address it. While extant bag of words based topic models are fairly good at attribute discovery based on frequency of word or phrase occurrences, associating sentiments to attributes requires exploiting the spatial and sequential structure of language. Second, they illustrate how to correct for attribute self-selection'reviewers choose the subset of attributes to write about'in metrics of attribute level restaurant performance. Using Yelp.com reviews for empirical illustration, they find that a hybrid deep learning (CNN-LSTM) model, where CNN and LSTM exploit the spatial and sequential structure of language respectively provide the best performance in accuracy, training speed and training data size requirements. The model does particularly well on the "hard" sentiment classification problems. Further, accounting for attribute self-selection significantly impacts sentiment scores, especially on attributes that are frequently missing.

Suggested Citation

  • Ishita Chakraborty & Minkyung Kim & K. Sudhir, 2019. "Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection," Cowles Foundation Discussion Papers 2176, Cowles Foundation for Research in Economics, Yale University.
  • Handle: RePEc:cwl:cwldpp:2176
    as

    Download full text from publisher

    File URL: https://cowles.yale.edu/sites/default/files/files/pub/d21/d2176.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    2. Dhar, Vasant & Chang, Elaine A., 2009. "Does Chatter Matter? The Impact of User-Generated Content on Music Sales," Journal of Interactive Marketing, Elsevier, vol. 23(4), pages 300-307.
    3. Jonah Berger & Alan T. Sorensen & Scott J. Rasmussen, 2010. "Positive Effects of Negative Publicity: When Negative Reviews Increase Sales," Marketing Science, INFORMS, vol. 29(5), pages 815-827, 09-10.
    4. Aron Culotta & Jennifer Cutler, 2016. "Mining Brand Perceptions from Twitter Social Networks," Marketing Science, INFORMS, vol. 35(3), pages 343-362, May.
    5. Xinxin Li & Lorin M. Hitt, 2008. "Self-Selection and Information Role of Online Product Reviews," Information Systems Research, INFORMS, vol. 19(4), pages 456-474, December.
    6. Dinesh Puranam & Vishal Narayan & Vrinda Kadiyali, 2017. "The Effect of Calorie Posting Regulation on Consumer Opinion: A Flexible Latent Dirichlet Allocation Model with Informative Priors," Marketing Science, INFORMS, vol. 36(5), pages 726-746, September.
    7. Michael Luca, 2011. "Reviews, Reputation, and Revenue: The Case of Yelp.com," Harvard Business School Working Papers 12-016, Harvard Business School, revised Mar 2016.
    8. Hollenbeck, Brett, 2018. "Online Reputation Mechanisms and the Decreasing Value of Chain Affliation," MPRA Paper 91573, University Library of Munich, Germany.
    9. Oded Netzer & Ronen Feldman & Jacob Goldenberg & Moshe Fresko, 2012. "Mine Your Own Business: Market-Structure Surveillance Through Text Mining," Marketing Science, INFORMS, vol. 31(3), pages 521-543, May.
    10. Liu Liu & Daria Dzyabura & Natalie Mizik, 2017. "Visual Listening In: Extracting Brand Image Portrayed on Social Media," Working Papers w0258, New Economic School (NES).
    11. Onishi, Hiroshi & Manchanda, Puneet, 2012. "Marketing activity, blogging and sales," International Journal of Research in Marketing, Elsevier, vol. 29(3), pages 221-234.
    12. Theodoros Lappas & Gaurav Sabnis & Georgios Valkanas, 2016. "The Impact of Fake Reviews on Online Visibility: A Vulnerability Assessment of the Hotel Industry," Information Systems Research, INFORMS, vol. 27(4), pages 940-961, December.
    13. Liu Liu & Daria Dzyabura & Natalie Mizik, 2020. "Visual Listening In: Extracting Brand Image Portrayed on Social Media," Marketing Science, INFORMS, vol. 39(4), pages 669-686, July.
    14. Michael Luca & Georgios Zervas, 2016. "Fake It Till You Make It: Reputation, Competition, and Yelp Review Fraud," Management Science, INFORMS, vol. 62(12), pages 3412-3427, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ishita Chakraborty & Joyee Deb & Aniko Oery, 2020. "When Do Consumers Talk?," Cowles Foundation Discussion Papers 2254R, Cowles Foundation for Research in Economics, Yale University, revised Mar 2021.
    2. Alex Burnap & John R. Hauser & Artem Timoshenko, 2019. "Product Aesthetic Design: A Machine Learning Augmentation," Papers 1907.07786, arXiv.org, revised Nov 2022.
    3. Shrestha, Yash Raj & Krishna, Vaibhav & von Krogh, Georg, 2021. "Augmenting organizational decision-making with deep learning algorithms: Principles, promises, and challenges," Journal of Business Research, Elsevier, vol. 123(C), pages 588-603.
    4. Ishita Chakraborty & Joyee Deb & Aniko Oery, 2020. "When Do Consumers Talk?," Cowles Foundation Discussion Papers 2254R2, Cowles Foundation for Research in Economics, Yale University, revised Jun 2022.
    5. Ma, Liye & Sun, Baohong, 2020. "Machine learning and AI in marketing – Connecting computing power to human insights," International Journal of Research in Marketing, Elsevier, vol. 37(3), pages 481-504.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ishita Chakraborty & Minkyung Kim & K. Sudhir, 2019. "Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection," Cowles Foundation Discussion Papers 2176R2, Cowles Foundation for Research in Economics, Yale University, revised Jun 2021.
    2. Ishita Chakraborty & Minkyung Kim & K. Sudhir, 2019. "Attribute Sentiment Scoring With Online Text Reviews : Accounting for Language Structure and Attribute Self-Selection," Cowles Foundation Discussion Papers 2176R, Cowles Foundation for Research in Economics, Yale University, revised Sep 2020.
    3. Carlson, Keith & Kopalle, Praveen K. & Riddell, Allen & Rockmore, Daniel & Vana, Prasad, 2023. "Complementing human effort in online reviews: A deep learning approach to automatic content generation and review synthesis," International Journal of Research in Marketing, Elsevier, vol. 40(1), pages 54-74.
    4. Maximilian Matthe & Daniel M. Ringel & Bernd Skiera, 2023. "Mapping Market Structure Evolution," Marketing Science, INFORMS, vol. 42(3), pages 589-613, May.
    5. Weijia Dai & Hyunjin Kim & Michael Luca, 2023. "Frontiers: Which Firms Gain from Digital Advertising? Evidence from a Field Experiment," Marketing Science, INFORMS, vol. 42(3), pages 429-439, May.
    6. Saridakis, Charalampos & Katsikeas, Constantine S. & Angelidou, Sofia & Oikonomidou, Maria & Pratikakis, Polyvios, 2023. "Mining Twitter lists to extract brand-related associative information for celebrity endorsement," European Journal of Operational Research, Elsevier, vol. 311(1), pages 316-332.
    7. Georgios Zervas & Davide Proserpio & John W. Byers, 2021. "A first look at online reputation on Airbnb, where every stay is above average," Marketing Letters, Springer, vol. 32(1), pages 1-16, March.
    8. Aishwarya Deep Shukla & Guodong (Gordon) Gao & Ritu Agarwal, 2021. "How Digital Word-of-Mouth Affects Consumer Decision Making: Evidence from Doctor Appointment Booking," Management Science, INFORMS, vol. 67(3), pages 1546-1568, March.
    9. Bitty Balducci & Detelina Marinova, 2018. "Unstructured data in marketing," Journal of the Academy of Marketing Science, Springer, vol. 46(4), pages 557-590, July.
    10. Colmekcioglu, Nazan & Marvi, Reza & Foroudi, Pantea & Okumus, Fevzi, 2022. "Generation, susceptibility, and response regarding negativity: An in-depth analysis on negative online reviews," Journal of Business Research, Elsevier, vol. 153(C), pages 235-250.
    11. Warut Khern-am-nuai & Karthik Kannan & Hossein Ghasemkhani, 2018. "Extrinsic versus Intrinsic Rewards for Contributing Reviews in an Online Platform," Information Systems Research, INFORMS, vol. 29(4), pages 871-892, December.
    12. Mengxia Zhang & Lan Luo, 2023. "Can Consumer-Posted Photos Serve as a Leading Indicator of Restaurant Survival? Evidence from Yelp," Management Science, INFORMS, vol. 69(1), pages 25-50, January.
    13. Brett Hollenbeck & Sridhar Moorthy & Davide Proserpio, 2019. "Advertising Strategy in the Presence of Reviews: An Empirical Analysis," Marketing Science, INFORMS, vol. 38(5), pages 793-811, September.
    14. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    15. Erfan Rezvani & Christian Rojas, 2022. "Firm responsiveness to consumers' reviews: The effect on online reputation," Journal of Economics & Management Strategy, Wiley Blackwell, vol. 31(4), pages 898-922, November.
    16. Cheng Zhao & Chong Alex Wang, 2023. "A cross-site comparison of online review manipulation using Benford’s law," Electronic Commerce Research, Springer, vol. 23(1), pages 365-406, March.
    17. Moon, Sangkil & Kim, Moon-Yong & Bergey, Paul K., 2019. "Estimating deception in consumer reviews based on extreme terms: Comparison analysis of open vs. closed hotel reservation platforms," Journal of Business Research, Elsevier, vol. 102(C), pages 83-96.
    18. Harrison-Walker, L. Jean & Jiang, Ying, 2023. "Suspicion of online product reviews as fake: Cues and consequences," Journal of Business Research, Elsevier, vol. 160(C).
    19. Ina Garnefeld & Sabrina Helm & Ann-Kathrin Grötschel, 2020. "May we buy your love? psychological effects of incentives on writing likelihood and valence of online product reviews," Electronic Markets, Springer;IIM University of St. Gallen, vol. 30(4), pages 805-820, December.
    20. Alzate, Miriam & Arce-Urriza, Marta & Cebollada, Javier, 2022. "Mining the text of online consumer reviews to analyze brand image and brand positioning," Journal of Retailing and Consumer Services, Elsevier, vol. 67(C).

    More about this item

    Keywords

    Text mining; Natural language processing (NLP); Convolutional neural networks (CNN); Long-short term memory (LSTM) Networks; Deep learning; Lexicons; Endogeneity; Self-selection; Online reviews; Online ratings; Customer satisfaction;
    All these keywords.

    JEL classification:

    • M1 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Business Administration
    • M3 - Business Administration and Business Economics; Marketing; Accounting; Personnel Economics - - Marketing and Advertising
    • C8 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs
    • C5 - Mathematical and Quantitative Methods - - Econometric Modeling

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cwl:cwldpp:2176. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Brittany Ladd (email available below). General contact details of provider: https://edirc.repec.org/data/cowleus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.