IDEAS home Printed from https://ideas.repec.org/a/eee/jbrese/v144y2022icp888-901.html
   My bibliography  Save this article

Are longer reviews always more helpful? Disentangling the interplay between review length and line of argumentation

Author

Listed:
  • Lutz, Bernhard
  • Pröllochs, Nicolas
  • Neumann, Dirk

Abstract

An overwhelming majority of previous works find longer product reviews to be more helpful than short reviews. In this paper, we build upon information overload theory and propose that longer reviews should not be assumed to be uniformly more helpful; instead, we argue that the effect depends on the complexity of the line of argumentation. To test this idea, we implement state-of-the-art machine learning methods that allow us to study the line of argumentation in reviews at the sentence-level. Our empirical analysis based on a dataset of Amazon customer reviews suggests that line of argumentation and review length are closely intertwined such that longer reviews with frequent changes between positive and negative arguments are perceived as less helpful. Our work has important implications for marketing professionals and retailer platforms that can utilize our results to optimize their customer feedback systems, enhance reviewer guidelines, and include more useful product reviews.

Suggested Citation

  • Lutz, Bernhard & Pröllochs, Nicolas & Neumann, Dirk, 2022. "Are longer reviews always more helpful? Disentangling the interplay between review length and line of argumentation," Journal of Business Research, Elsevier, vol. 144(C), pages 888-901.
  • Handle: RePEc:eee:jbrese:v:144:y:2022:i:c:p:888-901
    DOI: 10.1016/j.jbusres.2022.02.010
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0148296322001278
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jbusres.2022.02.010?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ruiz-Mafe, Carla & Chatzipanagiotou, Kalliopi & Curras-Perez, Rafael, 2018. "The role of emotions and conflicting online reviews on consumers' purchase intentions," Journal of Business Research, Elsevier, vol. 89(C), pages 336-344.
    2. Wang, Fang & Karimi, Sahar, 2019. "This product works well (for me): The impact of first-person singular pronouns on online review helpfulness," Journal of Business Research, Elsevier, vol. 104(C), pages 283-294.
    3. Zheng, Lili, 2021. "The classification of online consumer reviews: A systematic literature review and integrative framework," Journal of Business Research, Elsevier, vol. 135(C), pages 226-251.
    4. Jacoby, Jacob & Speller, Donald E & Berning, Carol A Kohn, 1974. "Brand Choice Behavior as a Function of Information Load: Replication and Extension," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 1(1), pages 33-42, June.
    5. Nikolay Archak & Anindya Ghose & Panagiotis G. Ipeirotis, 2011. "Deriving the Pricing Power of Product Features by Mining Consumer Reviews," Management Science, INFORMS, vol. 57(8), pages 1485-1509, August.
    6. Dezhi Yin & Sabyasachi Mitra & Han Zhang, 2016. "Research Note—When Do Consumers Value Positive vs. Negative Reviews? An Empirical Investigation of Confirmation Bias in Online Word of Mouth," Information Systems Research, INFORMS, vol. 27(1), pages 131-144, March.
    7. Linda Hagen & Kosuke Uetake & Nathan Yang & Bryan Bollinger & Allison J. B. Chaney & Daria Dzyabura & Jordan Etkin & Avi Goldfarb & Liu Liu & K. Sudhir & Yanwen Wang & James R. Wright & Ying Zhu, 2020. "How can machine learning aid behavioral marketing research?," Marketing Letters, Springer, vol. 31(4), pages 361-370, December.
    8. Matthew Gentzkow & Bryan Kelly & Matt Taddy, 2019. "Text as Data," Journal of Economic Literature, American Economic Association, vol. 57(3), pages 535-574, September.
    9. Christopher P. Furner & Robert A. Zinko, 2017. "The influence of information overload on the development of trust and purchase intention based on online product reviews in a mobile vs. web environment: an empirical investigation," Electronic Markets, Springer;IIM University of St. Gallen, vol. 27(3), pages 211-224, August.
    10. Sheth, Jagdish & Kellstadt, Charles H., 2021. "Next frontiers of research in data driven marketing: Will techniques keep up with data tsunami?," Journal of Business Research, Elsevier, vol. 125(C), pages 780-784.
    11. Jang, Seongsoo & Chung, Jaihak & Rao, Vithala R., 2021. "The importance of functional and emotional content in online consumer reviews for product sales: Evidence from the mobile gaming market," Journal of Business Research, Elsevier, vol. 130(C), pages 583-593.
    12. Kuenzel, Johanna & Musters, Pieter, 2007. "Social interaction and low involvement products," Journal of Business Research, Elsevier, vol. 60(8), pages 876-883, August.
    13. David Godes & Dina Mayzlin, 2004. "Using Online Conversations to Study Word-of-Mouth Communication," Marketing Science, INFORMS, vol. 23(4), pages 545-560, June.
    14. Dellarocas, Chrysanthos, 2003. "The Digitization of Word-of-mouth: Promise and Challenges of Online Feedback Mechanisms," Working papers 4296-03, Massachusetts Institute of Technology (MIT), Sloan School of Management.
    15. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, December.
    16. Rust, Roland T., 2020. "The future of marketing," International Journal of Research in Marketing, Elsevier, vol. 37(1), pages 15-26.
    17. Vermeer, Susan A.M. & Araujo, Theo & Bernritter, Stefan F. & van Noort, Guda, 2019. "Seeing the wood for the trees: How machine learning can help firms in identifying relevant electronic word-of-mouth in social media," International Journal of Research in Marketing, Elsevier, vol. 36(3), pages 492-508.
    18. Srivastava, Vartika & Kalro, Arti D., 2019. "Enhancing the Helpfulness of Online Consumer Reviews: The Role of Latent (Content) Factors," Journal of Interactive Marketing, Elsevier, vol. 48(C), pages 33-50.
    19. Cheng, Yi-Hsiu & Ho, Hui-Yi, 2015. "Social influence's impact on reader perceptions of online reviews," Journal of Business Research, Elsevier, vol. 68(4), pages 883-887.
    20. Zhu, Yongmin & Liu, Miaomiao & Zeng, Xiaohua & Huang, Pei, 2020. "The effects of prior reviews on perceived review helpfulness: A configuration perspective," Journal of Business Research, Elsevier, vol. 110(C), pages 484-494.
    21. Eric J. Johnson & John W. Payne, 1985. "Effort and Accuracy in Choice," Management Science, INFORMS, vol. 31(4), pages 395-414, April.
    22. Chrysanthos Dellarocas, 2003. "The Digitization of Word of Mouth: Promise and Challenges of Online Feedback Mechanisms," Management Science, INFORMS, vol. 49(10), pages 1407-1424, October.
    23. Angelika Dimoka & Paul A. Pavlou & Fred D. Davis, 2011. "Research Commentary ---NeuroIS: The Potential of Cognitive Neuroscience for Information Systems Research," Information Systems Research, INFORMS, vol. 22(4), pages 687-702, December.
    24. Yubo Chen & Jinhong Xie, 2008. "Online Consumer Review: Word-of-Mouth as a New Element of Marketing Communication Mix," Management Science, INFORMS, vol. 54(3), pages 477-491, March.
    25. Stephen X. He & Samuel D. Bond, 2015. "Why Is the Crowd Divided? Attribution for Dispersion in Online Word of Mouth," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 41(6), pages 1509-1527.
    26. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    27. Jean-Noël Kapferer & Gilles Laurent, 1985. "Measuring consumer involvement profiles," Post-Print hal-00786781, HAL.
    28. Lurie, Nicholas H, 2004. "Decision Making in Information-Rich Environments: The Role of Information Structure," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 30(4), pages 473-486, March.
    29. Pan, Yue & Zhang, Jason Q., 2011. "Born Unequal: A Study of the Helpfulness of User-Generated Product Reviews," Journal of Retailing, Elsevier, vol. 87(4), pages 598-612.
    30. Zhang, Jason Q. & Craciun, Georgiana & Shin, Dongwoo, 2010. "When does electronic word-of-mouth matter? A study of consumer product reviews," Journal of Business Research, Elsevier, vol. 63(12), pages 1336-1341, December.
    31. Fernando Branco & Monic Sun & J. Miguel Villas-Boas, 2012. "Optimal Search for Product Information," Management Science, INFORMS, vol. 58(11), pages 2037-2056, November.
    32. Malhotra, Naresh K, 1982. "Information Load and Consumer Decision Making," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 8(4), pages 419-430, March.
    33. Singh, Amit & Jenamani, Mamata & Thakkar, Jitesh J. & Rana, Nripendra P., 2022. "Quantifying the effect of eWOM embedded consumer perceptions on sales: An integrated aspect-level sentiment analysis and panel data modeling approach," Journal of Business Research, Elsevier, vol. 138(C), pages 52-64.
    34. Gottschalk, Sabrina A. & Mafael, Alexander, 2017. "Cutting Through the Online Review Jungle — Investigating Selective eWOM Processing," Journal of Interactive Marketing, Elsevier, vol. 37(C), pages 89-104.
    35. Malhotra, Naresh K, 1984. "Reflections on the Information Overload Paradigm in Consumer Decision Making [Perspectives on Information Overload]," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 10(4), pages 436-440, March.
    36. Ketron, Seth, 2017. "Investigating the effect of quality of grammar and mechanics (QGAM) in online reviews: The mediating role of reviewer crediblity," Journal of Business Research, Elsevier, vol. 81(C), pages 51-59.
    37. Thomas Davenport & Abhijit Guha & Dhruv Grewal & Timna Bressgott, 2020. "How artificial intelligence will change the future of marketing," Journal of the Academy of Marketing Science, Springer, vol. 48(1), pages 24-42, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yi Feng & Yunqiang Yin & Dujuan Wang & Lalitha Dhamotharan & Joshua Ignatius & Ajay Kumar, 2023. "Diabetic patient review helpfulness: unpacking online drug treatment reviews by text analytics and design science approach," Annals of Operations Research, Springer, vol. 328(1), pages 387-418, September.
    2. Henrik Sällberg & Shujun Wang & Emil Numminen, 2023. "The combinatory role of online ratings and reviews in mobile app downloads: an empirical investigation of gaming and productivity apps from their initial app store launch," Journal of Marketing Analytics, Palgrave Macmillan, vol. 11(3), pages 426-442, September.
    3. Harrison-Walker, L. Jean & Jiang, Ying, 2023. "Suspicion of online product reviews as fake: Cues and consequences," Journal of Business Research, Elsevier, vol. 160(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Moradi, Masoud & Dass, Mayukh & Kumar, Piyush, 2023. "Differential effects of analytical versus emotional rhetorical style on review helpfulness," Journal of Business Research, Elsevier, vol. 154(C).
    2. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    3. Guha Majumder, Madhumita & Dutta Gupta, Sangita & Paul, Justin, 2022. "Perceived usefulness of online customer reviews: A review mining approach using machine learning & exploratory data analysis," Journal of Business Research, Elsevier, vol. 150(C), pages 147-164.
    4. Jifeng Luo & Ying Rong & Huan Zheng, 2020. "Impacts of logistics information on sales: Evidence from Alibaba," Naval Research Logistics (NRL), John Wiley & Sons, vol. 67(8), pages 646-669, December.
    5. Zhuolan Bao & Wenwen Li & Pengzhen Yin & Michael Chau, 2021. "Examining the impact of review tag function on product evaluation and information perception of popular products," Information Systems and e-Business Management, Springer, vol. 19(2), pages 517-539, June.
    6. Juan Feng & Xin Li & Xiaoquan (Michael) Zhang, 2019. "Online Product Reviews-Triggered Dynamic Pricing: Theory and Evidence," Information Systems Research, INFORMS, vol. 30(4), pages 1107-1123, December.
    7. King, Robert Allen & Racherla, Pradeep & Bush, Victoria D., 2014. "What We Know and Don't Know About Online Word-of-Mouth: A Review and Synthesis of the Literature," Journal of Interactive Marketing, Elsevier, vol. 28(3), pages 167-183.
    8. Tao Lu & May Yuan & Chong (Alex) Wang & Xiaoquan (Michael) Zhang, 2022. "Histogram Distortion Bias in Consumer Choices," Management Science, INFORMS, vol. 68(12), pages 8963-8978, December.
    9. Heeseung Andrew Lee & Angela Aerry Choi & Tianshu Sun & Wonseok Oh, 2021. "Reviewing Before Reading? An Empirical Investigation of Book-Consumption Patterns and Their Effects on Reviews and Sales," Information Systems Research, INFORMS, vol. 32(4), pages 1368-1389, December.
    10. Bin Gu & Jaehong Park & Prabhudev Konana, 2012. "Research Note ---The Impact of External Word-of-Mouth Sources on Retailer Sales of High-Involvement Products," Information Systems Research, INFORMS, vol. 23(1), pages 182-196, March.
    11. Janina Seutter & Kristin Kutzner & Maren Stadtländer & Dennis Kundisch & Ralf Knackstedt, 2023. "“Sorry, too much information”—Designing online review systems that support information search and processing," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-19, December.
    12. Raoofpanah, Iman & Zamudio, César & Groening, Christopher, 2023. "Review reader segmentation based on the heterogeneous impacts of review and reviewer attributes on review helpfulness: A study involving ZIP code data," Journal of Retailing and Consumer Services, Elsevier, vol. 72(C).
    13. Floyd, Kristopher & Freling, Ryan & Alhoqail, Saad & Cho, Hyun Young & Freling, Traci, 2014. "How Online Product Reviews Affect Retail Sales: A Meta-analysis," Journal of Retailing, Elsevier, vol. 90(2), pages 217-232.
    14. Yabing Jiang & Hong Guo, 2015. "Design of Consumer Review Systems and Product Pricing," Information Systems Research, INFORMS, vol. 26(4), pages 714-730, December.
    15. Colmekcioglu, Nazan & Marvi, Reza & Foroudi, Pantea & Okumus, Fevzi, 2022. "Generation, susceptibility, and response regarding negativity: An in-depth analysis on negative online reviews," Journal of Business Research, Elsevier, vol. 153(C), pages 235-250.
    16. Zhen Li & Fangzhou Li & Jing Xiao & Zhi Yang, 2020. "Topic Features in Negative Customer Reviews: Evidence Based on Text Data Mining," The Review of Socionetwork Strategies, Springer, vol. 14(1), pages 19-40, April.
    17. Lorenz Graf-Vlachy & Tarun Goyal & Yannick Ouardi & Andreas König, 2021. "Reviews Left and Right: The Link Between Reviewers’ Political Ideology and Online Review Language," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 63(4), pages 403-417, August.
    18. Yabing Jiang & Hong Guo, 2012. "Design of Consumer Review Systems and Product Pricing," Working Papers 12-10, NET Institute.
    19. Yani Wang & Jun Wang & Tang Yao, 2019. "What makes a helpful online review? A meta-analysis of review characteristics," Electronic Commerce Research, Springer, vol. 19(2), pages 257-284, June.
    20. Hossin Md Altab & Mu Yinping & Hosain Md Sajjad & Adasa Nkrumah Kofi Frimpong & Michelle Frempomaa Frempong & Stephen Sarfo Adu-Yeboah, 2022. "Understanding Online Consumer Textual Reviews and Rating: Review Length With Moderated Multiple Regression Analysis Approach," SAGE Open, , vol. 12(2), pages 21582440221, June.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jbrese:v:144:y:2022:i:c:p:888-901. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jbusres .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.