IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v30y2019i3p805-818.html
   My bibliography  Save this article

Word-of-Mouth System Implementation and Customer Conversion: A Randomized Field Experiment

Author

Listed:
  • Ni Huang

    (W. P. Carey School of Business, Arizona State University, Tempe, Arizona 85287)

  • Tianshu Sun

    (Marshall School of Business, University of Southern California, Los Angeles, California 90089)

  • Peiyu Chen

    (W. P. Carey School of Business, Arizona State University, Tempe, Arizona 85287)

  • Joseph M. Golden

    (Collage.com, San Francisco, California 94122)

Abstract

E-commerce firms often face the decision on whether they should implement a word-of-mouth (WOM) system on their websites. An in-site WOM system can potentially boost customer conversion by conveying signals and information about product popularity and quality. However, implementing such a system might also have unintended consequences, hindering product sales because of the lack of control over WOM volume and content. This study examines how implementing a WOM system (through social media integration) on an e-commerce website affects customer conversion in the two stages of the consumer purchase funnel, namely, adding a product to the cart and placing an order. Identifying the causal effect of WOM system implementation is challenging because e-commerce websites usually make their decisions based on private information about the potential impact of the system and may have simultaneously implemented other initiatives that could confound the effect. As a result, we conducted a randomized field experiment in collaboration with a large e-commerce website in the United States by testing two versions of a web page: one with a WOM system (treatment) and one without (control). We find that the impact of a WOM system implementation on customer conversion is moderated by WOM volume such that its effect is positive above a threshold of volume (measured by the number of comments) and negative below the threshold. Additionally, we find that WOM valence reinforces the impact of a WOM system on customer conversion. These results suggest that a social-learning mechanism is in play. Furthermore, our results show that the impact of a WOM system mostly occurs at the consideration stage in the upper purchase funnel (adding a product to the cart) rather than at the evaluation stage in the lower funnel (placing an order). Our study not only contributes to research on online system design but also offers practical implications for implementing and managing WOM systems on e-commerce websites.

Suggested Citation

  • Ni Huang & Tianshu Sun & Peiyu Chen & Joseph M. Golden, 2019. "Word-of-Mouth System Implementation and Customer Conversion: A Randomized Field Experiment," Information Systems Research, INFORMS, vol. 30(3), pages 805-818, September.
    • Handle: RePEc:inm:orisre:v:30:y:2019:i:3:p:805-818
    DOI: 10.1287/isre.2018.0832
    as

    Download full text from publisher

    File URL: https://doi.org/10.1287/isre.2018.0832
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2018.0832?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. V. Krishnan & Saurabh Gupta, 2001. "Appropriateness and Impact of Platform-Based Product Development," Management Science, INFORMS, vol. 47(1), pages 52-68, January.
    2. Catherine Tucker & Juanjuan Zhang & Ting Zhu, 2013. "Days on market and home sales," RAND Journal of Economics, RAND Corporation, vol. 44(2), pages 337-360, June.
    3. Young Kwark & Jianqing Chen & Srinivasan Raghunathan, 2014. "Online Product Reviews: Implications for Retailers and Competing Manufacturers," Information Systems Research, INFORMS, vol. 25(1), pages 93-110, March.
    4. Sam Ransbotham & Nicholas H. Lurie & Hongju Liu, 2019. "Creation and Consumption of Mobile Word of Mouth: How Are Mobile Reviews Different?," Marketing Science, INFORMS, vol. 38(5), pages 773-792, September.
    5. Dedman, Elisabeth & Lennox, Clive, 2009. "Perceived competition, profitability and the withholding of information about sales and the cost of sales," Journal of Accounting and Economics, Elsevier, vol. 48(2-3), pages 210-230, December.
    6. Yili (Kevin) Hong & Paul A. Pavlou, 2014. "Product Fit Uncertainty in Online Markets: Nature, Effects, and Antecedents," Information Systems Research, INFORMS, vol. 25(2), pages 328-344, June.
    7. Xianghua Lu & Sulin Ba & Lihua Huang & Yue Feng, 2013. "Promotional Marketing or Word-of-Mouth? Evidence from Online Restaurant Reviews," Information Systems Research, INFORMS, vol. 24(3), pages 596-612, September.
    8. Duan, Wenjing & Gu, Bin & Whinston, Andrew B., 2008. "The dynamics of online word-of-mouth and product sales—An empirical investigation of the movie industry," Journal of Retailing, Elsevier, vol. 84(2), pages 233-242.
    9. Gilles Laurent & Pierre Chandon & Brian Wansink, 2000. "A Benefit Congruency Framework of Sales Promotion Effectiveness," Post-Print hal-00458440, HAL.
    10. Hailiang Chen & Prabuddha De & Yu Jeffrey Hu, 2015. "IT-Enabled Broadcasting in Social Media: An Empirical Study of Artists’ Activities and Music Sales," Information Systems Research, INFORMS, vol. 26(3), pages 513-531, September.
    11. Yabing Jiang & Hong Guo, 2015. "Design of Consumer Review Systems and Product Pricing," Information Systems Research, INFORMS, vol. 26(4), pages 714-730, December.
    12. Bettman, James R & Luce, Mary Frances & Payne, John W, 1998. "Constructive Consumer Choice Processes," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 25(3), pages 187-217, December.
    13. Lei Zhu & Izak Benbasat & Zhenhui Jiang, 2010. "Let's Shop Online Together: An Empirical Investigation of Collaborative Online Shopping Support," Information Systems Research, INFORMS, vol. 21(4), pages 872-891, December.
    14. Chris Forman & Anindya Ghose & Batia Wiesenfeld, 2008. "Examining the Relationship Between Reviews and Sales: The Role of Reviewer Identity Disclosure in Electronic Markets," Information Systems Research, INFORMS, vol. 19(3), pages 291-313, September.
    15. Bikhchandani, Sushil & Hirshleifer, David & Welch, Ivo, 1992. "A Theory of Fads, Fashion, Custom, and Cultural Change in Informational Cascades," Journal of Political Economy, University of Chicago Press, vol. 100(5), pages 992-1026, October.
    16. Damon E. Campbell & John D. Wells & Joseph S. Valacich, 2013. "Breaking the Ice in B2C Relationships: Understanding Pre-Adoption E-Commerce Attraction," Information Systems Research, INFORMS, vol. 24(2), pages 219-238, June.
    17. Dezhi Yin & Sabyasachi Mitra & Han Zhang, 2016. "Research Note—When Do Consumers Value Positive vs. Negative Reviews? An Empirical Investigation of Confirmation Bias in Online Word of Mouth," Information Systems Research, INFORMS, vol. 27(1), pages 131-144, March.
    18. Horrace, William C. & Oaxaca, Ronald L., 2006. "Results on the bias and inconsistency of ordinary least squares for the linear probability model," Economics Letters, Elsevier, vol. 90(3), pages 321-327, March.
    19. Huseyin Cavusoglu & Tuan Q. Phan & Hasan Cavusoglu & Edoardo M. Airoldi, 2016. "Assessing the Impact of Granular Privacy Controls on Content Sharing and Disclosure on Facebook," Information Systems Research, INFORMS, vol. 27(4), pages 848-879, December.
    20. Abhijit V. Banerjee, 1992. "A Simple Model of Herd Behavior," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 107(3), pages 797-817.
    21. Peter E. Rossi & Robert E. McCulloch & Greg M. Allenby, 1996. "The Value of Purchase History Data in Target Marketing," Marketing Science, INFORMS, vol. 15(4), pages 321-340.
    22. Anja Lambrecht & Katja Seim & Catherine Tucker, 2011. "Stuck in the Adoption Funnel: The Effect of Interruptions in the Adoption Process on Usage," Marketing Science, INFORMS, vol. 30(2), pages 355-367, 03-04.
    23. Naveen Kumar & Liangfei Qiu & Subodha Kumar, 2018. "Exit, Voice, and Response on Digital Platforms: An Empirical Investigation of Online Management Response Strategies," Information Systems Research, INFORMS, vol. 29(4), pages 849-870, December.
    24. Nachiketa Sahoo & Chrysanthos Dellarocas & Shuba Srinivasan, 2018. "The Impact of Online Product Reviews on Product Returns," Information Systems Research, INFORMS, vol. 29(3), pages 723-738, September.
    25. Gordon Burtch & Yili Hong & Ravi Bapna & Vladas Griskevicius, 2018. "Stimulating Online Reviews by Combining Financial Incentives and Social Norms," Management Science, INFORMS, vol. 64(5), pages 2065-2082, May.
    26. Jörg Claussen & Tobias Kretschmer & Philip Mayrhofer, 2013. "The Effects of Rewarding User Engagement: The Case of Facebook Apps," Information Systems Research, INFORMS, vol. 24(1), pages 186-200, March.
    27. Davide Proserpio & Georgios Zervas, 2017. "Online Reputation Management: Estimating the Impact of Management Responses on Consumer Reviews," Marketing Science, INFORMS, vol. 36(5), pages 645-665, September.
    28. Alexander Bleier & Maik Eisenbeiss, 2015. "Personalized Online Advertising Effectiveness: The Interplay of What, When, and Where," Marketing Science, INFORMS, vol. 34(5), pages 669-688, September.
    29. David Godes & Dina Mayzlin, 2004. "Using Online Conversations to Study Word-of-Mouth Communication," Marketing Science, INFORMS, vol. 23(4), pages 545-560, June.
    30. Catherine Tucker & Juanjuan Zhang, 2011. "How Does Popularity Information Affect Choices? A Field Experiment," Management Science, INFORMS, vol. 57(5), pages 828-842, May.
    31. Erik Brynjolfsson & Yu (Jeffrey) Hu & Michael D. Smith, 2010. "Research Commentary --- Long Tails vs. Superstars: The Effect of Information Technology on Product Variety and Sales Concentration Patterns," Information Systems Research, INFORMS, vol. 21(4), pages 736-747, December.
    32. Amalia R. Miller & Catherine Tucker, 2013. "Active Social Media Management: The Case of Health Care," Information Systems Research, INFORMS, vol. 24(1), pages 52-70, March.
    33. Pei-Yu Chen & Yili Hong & Ying Liu, 2018. "The Value of Multidimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments," Management Science, INFORMS, vol. 64(10), pages 4629-4647, October.
    34. Michael Lewis & Vishal Singh & Scott Fay, 2006. "An Empirical Study of the Impact of Nonlinear Shipping and Handling Fees on Purchase Incidence and Expenditure Decisions," Marketing Science, INFORMS, vol. 25(1), pages 51-64, 01-02.
    35. LAURENT, Gilles & CHANDON, Pierre & WANSINK, Brian, 2000. "A benefit congruency framework of sales promotion effectiveness," HEC Research Papers Series 698, HEC Paris.
    36. Bo Xiao & Izak Benbasat, 2015. "Designing Warning Messages for Detecting Biased Online Product Recommendations: An Empirical Investigation," Information Systems Research, INFORMS, vol. 26(4), pages 793-811, December.
    37. Juanjuan Zhang, 2010. "The Sound of Silence: Observational Learning in the U.S. Kidney Market," Marketing Science, INFORMS, vol. 29(2), pages 315-335, 03-04.
    38. Kietzmann, Jan H. & Hermkens, Kristopher & McCarthy, Ian P. & Silvestre, Bruno S., 2011. "Social media? Get serious! Understanding the functional building blocks of social media," Business Horizons, Elsevier, vol. 54(3), pages 241-251, May.
    39. Cheng Yi & Zhenhui (Jack) Jiang & Izak Benbasat, 2017. "Designing for Diagnosticity and Serendipity: An Investigation of Social Product-Search Mechanisms," Information Systems Research, INFORMS, vol. 28(2), pages 413-429, June.
    40. Juanjuan Zhang & Peng Liu, 2012. "Rational Herding in Microloan Markets," Management Science, INFORMS, vol. 58(5), pages 892-912, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chenshuo Sun & Panagiotis Adamopoulos & Anindya Ghose & Xueming Luo, 2022. "Predicting Stages in Omnichannel Path to Purchase: A Deep Learning Model," Information Systems Research, INFORMS, vol. 33(2), pages 429-445, June.
    2. Nazir, Sajjad & Khadim, Sahar & Ali Asadullah, Muhammad & Syed, Nausheen, 2023. "Exploring the influence of artificial intelligence technology on consumer repurchase intention: The mediation and moderation approach," Technology in Society, Elsevier, vol. 72(C).
    3. Ni Huang & Probal Mojumder & Tianshu Sun & Jinchi Lv & Joseph M. Golden, 2021. "Not Registered? Please Sign Up First: A Randomized Field Experiment on the Ex Ante Registration Request," Information Systems Research, INFORMS, vol. 32(3), pages 914-931, September.
    4. Lucas, Benjamin & Francu, R. Elena & Goulding, James & Harvey, John & Nica-Avram, Georgiana & Perrat, Bertrand, 2021. "A Note on Data-driven Actor-differentiation and SDGs 2 and 12: Insights from a Food-sharing App," Research Policy, Elsevier, vol. 50(6).
    5. Yuan Chen & Hsing Kenneth Cheng & Yang Liu & Jingchuan Pu & Liangfei Qiu & Ning Wang, 2022. "Knowledge‐sharing ties and equivalence in corporate online communities: A novel source to understand voluntary turnover," Production and Operations Management, Production and Operations Management Society, vol. 31(10), pages 3896-3913, October.
    6. Tianshu Sun & Siva Viswanathan & Elena Zheleva, 2021. "Creating Social Contagion Through Firm-Mediated Message Design: Evidence from a Randomized Field Experiment," Management Science, INFORMS, vol. 67(2), pages 808-827, February.
    7. Xiaoxi Zhu & Changhui Yang & Kai Liu & Rui Zhang & Qingquan Jiang, 2022. "Cooperation and decision making in a two-sided market motivated by the externality of a third-party social media platform," Annals of Operations Research, Springer, vol. 316(1), pages 117-142, September.
    8. Martin Adam & Konstantin Roethke & Alexander Benlian, 2023. "Human vs. Automated Sales Agents: How and Why Customer Responses Shift Across Sales Stages," Information Systems Research, INFORMS, vol. 34(3), pages 1148-1168, September.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dominik Gutt & Jürgen Neumann & Steffen Zimmermann & Dennis Kundisch & Jianqing Chen, 2018. "Design of Review Systems - A Strategic Instrument to shape Online Review Behavior and Economic Outcomes," Working Papers Dissertations 42, Paderborn University, Faculty of Business Administration and Economics.
    2. Ni Huang & Probal Mojumder & Tianshu Sun & Jinchi Lv & Joseph M. Golden, 2021. "Not Registered? Please Sign Up First: A Randomized Field Experiment on the Ex Ante Registration Request," Information Systems Research, INFORMS, vol. 32(3), pages 914-931, September.
    3. Chong (Alex) Wang & Xiaoquan (Michael) Zhang & Il-Horn Hann, 2018. "Socially Nudged: A Quasi-Experimental Study of Friends’ Social Influence in Online Product Ratings," Information Systems Research, INFORMS, vol. 29(3), pages 641-655, September.
    4. Liangfei Qiu & Asoo Vakharia & Arunima Chhikara, 2019. "Multi-Dimensional Observational Learning in Social Networks: Theory and Experimental Evidence," Working Papers 19-01, NET Institute.
    5. Young Kwark & Gene Moo Lee & Paul A. Pavlou & Liangfei Qiu, 2021. "On the Spillover Effects of Online Product Reviews on Purchases: Evidence from Clickstream Data," Information Systems Research, INFORMS, vol. 32(3), pages 895-913, September.
    6. Ji Wu & Haichuan Zhao & Haipeng (Allan) Chen, 2021. "Coupons or Free Shipping? Effects of Price Promotion Strategies on Online Review Ratings," Information Systems Research, INFORMS, vol. 32(2), pages 633-652, June.
    7. Tianshu Sun & Siva Viswanathan & Elena Zheleva, 2021. "Creating Social Contagion Through Firm-Mediated Message Design: Evidence from a Randomized Field Experiment," Management Science, INFORMS, vol. 67(2), pages 808-827, February.
    8. Jurui Zhang & Yong Liu & Yubo Chen, 2015. "Social Learning in Networks of Friends versus Strangers," Marketing Science, INFORMS, vol. 34(4), pages 573-589, July.
    9. Cheng Zhao & Chong Alex Wang, 2023. "A cross-site comparison of online review manipulation using Benford’s law," Electronic Commerce Research, Springer, vol. 23(1), pages 365-406, March.
    10. Liangfei Qiu & Zhan (Michael) Shi & Andrew B. Whinston, 2018. "Learning from Your Friends’ Check-Ins: An Empirical Study of Location-Based Social Networks," Information Systems Research, INFORMS, vol. 29(4), pages 1044-1061, December.
    11. Mina Ameri & Elisabeth Honka & Ying Xie, 2019. "Word of Mouth, Observed Adoptions, and Anime-Watching Decisions: The Role of the Personal vs. the Community Network," Marketing Science, INFORMS, vol. 38(4), pages 567-583, July.
    12. Christoph Schneider & Markus Weinmann & Peter N.C. Mohr & Jan vom Brocke, 2021. "When the Stars Shine Too Bright: The Influence of Multidimensional Ratings on Online Consumer Ratings," Management Science, INFORMS, vol. 67(6), pages 3871-3898, June.
    13. Yabing Jiang & Hong Guo, 2015. "Design of Consumer Review Systems and Product Pricing," Information Systems Research, INFORMS, vol. 26(4), pages 714-730, December.
    14. Wei Zhang & Linhui Sun & Xinping Wang & Anbo Wu, 2022. "The influence of AI word‐of‐mouth system on consumers' purchase behaviour: The mediating effect of risk perception," Systems Research and Behavioral Science, Wiley Blackwell, vol. 39(3), pages 516-530, May.
    15. Li, Yiming & Li, Gang & Tayi, Giri Kumar & Cheng, T.C.E., 2019. "Omni-channel retailing: Do offline retailers benefit from online reviews?," International Journal of Production Economics, Elsevier, vol. 218(C), pages 43-61.
    16. Duan, Yongrui & Liu, Tonghui & Mao, Zhixin, 2022. "How online reviews and coupons affect sales and pricing: An empirical study based on e-commerce platform," Journal of Retailing and Consumer Services, Elsevier, vol. 65(C).
    17. Liangfei Qiu & Arunima Chhikara & Asoo Vakharia, 2021. "Multidimensional Observational Learning in Social Networks: Theory and Experimental Evidence," Information Systems Research, INFORMS, vol. 32(3), pages 876-894, September.
    18. Shijie Lu & Dai Yao & Xingyu Chen & Rajdeep Grewal, 2021. "Do Larger Audiences Generate Greater Revenues Under Pay What You Want? Evidence from a Live Streaming Platform," Marketing Science, INFORMS, vol. 40(5), pages 964-984, September.
    19. Amy Wenxuan Ding & Shibo Li, 2019. "Herding in the consumption and purchase of digital goods and moderators of the herding bias," Journal of the Academy of Marketing Science, Springer, vol. 47(3), pages 460-478, May.
    20. Yang Liu & Juan Feng & Xiuwu Liao, 2017. "When Online Reviews Meet Sales Volume Information: Is More or Accurate Information Always Better?," Information Systems Research, INFORMS, vol. 28(4), pages 723-743, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:30:y:2019:i:3:p:805-818. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.