IDEAS home Printed from https://ideas.repec.org/a/inm/orisre/v26y2015i4p793-811.html
   My bibliography  Save this article

Designing Warning Messages for Detecting Biased Online Product Recommendations: An Empirical Investigation

Author

Listed:
  • Bo Xiao

    (Information Technology Management Department, Shidler College of Business, University of Hawai’i at Mānoa, Honolulu, Hawaii 96822)

  • Izak Benbasat

    (Sauder School of Business, University of British Columbia, Vancouver, British Columbia V6T 1Z2, Canada)

Abstract

The increasing adoption of product recommendation agents (PRAs) by e-commerce merchants makes it an important area of study for information systems researchers. PRAs are a type of Web personalization technology that provides individual consumers with product recommendations based on their product-related needs and preferences expressed explicitly or implicitly. Whereas extant research mainly assumes that such recommendation technologies are designed to benefit consumers and focuses on the positive impact of PRAs on consumers’ decision quality and decision effort, this study represents an early effort to examine PRAs that are designed to produce their recommendations on the basis of benefiting e-commerce merchants (rather than benefiting consumers) and to investigate how the availability and the design of warning messages (a potential detection support mechanism) can enhance consumers’ performance in detecting such biased PRAs. Drawing on signal detection theory, the literature on warning messages, and the literature on message framing, we identified two content design characteristics of warning messages—the inclusion of risk-handling advice and the framing of risk-handling advice—and investigated how they influence consumers’ detection performance. The results of an online experiment reveal that a simple warning message without accompanying advice on how to detect bias is a double-edged sword, because it increases correct detection of biased PRAs ( hits ) at the cost of increased incorrect detection ( false alarms ). By contrast, including in warning messages risk-handling advice about how to check for bias (particularly when the advice is framed to emphasize the loss from not following the advice) increases correct detection and, more importantly, also decreases incorrect detection. The patterns of findings are in line with the predictions of signal detection theory. With an enriched understanding of how the availability and the content design of warning messages can assist consumers in the context of PRA-assisted online shopping, the results of this study serve as a basis for future theoretical development and yield valuable insights that can guide practice and the design of effective warning messages.

Suggested Citation

  • Bo Xiao & Izak Benbasat, 2015. "Designing Warning Messages for Detecting Biased Online Product Recommendations: An Empirical Investigation," Information Systems Research, INFORMS, vol. 26(4), pages 793-811, December.
    • Handle: RePEc:inm:orisre:v:26:y:2015:i:4:p:793-811
    DOI: 10.1287/isre.2015.0592
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/isre.2015.0592
    Download Restriction: no
    File URL: https://libkey.io/10.1287/isre.2015.0592?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Bo Xiao & Izak Benbasat, 2014. "Research on the Use, Characteristics, and Impact of e-Commerce Product Recommendation Agents: A Review and Update for 2007–2012," Progress in IS, in: Francisco J. Martínez-López (ed.), Handbook of Strategic e-Business Management, edition 127, pages 403-431, Springer.
    2. Punj, Girish & Moore, Robert, 2009. "Information search and consideration set formation in a web-based store environment," Journal of Business Research, Elsevier, vol. 62(6), pages 644-650, June.
    3. Johnson, Paul E. & Grazioli, Stefano & Jamal, Karim, 1993. "Fraud detection: Intentionality and deception in cognition," Accounting, Organizations and Society, Elsevier, vol. 18(5), pages 467-488, July.
    4. Stefano Grazioli, 2004. "Where Did They Go Wrong? An Analysis of the Failure of Knowledgeable Internet Consumers to Detect Deception Over the Internet," Group Decision and Negotiation, Springer, vol. 13(2), pages 149-172, March.
    5. Levin, Irwin P. & Schneider, Sandra L. & Gaeth, Gary J., 1998. "All Frames Are Not Created Equal: A Typology and Critical Analysis of Framing Effects," Organizational Behavior and Human Decision Processes, Elsevier, vol. 76(2), pages 149-188, November.
    6. Levin, Irwin P. & Gaeth, Gary J. & Schreiber, Judy & Lauriola, Marco, 2002. "A New Look at Framing Effects: Distribution of Effect Sizes, Individual Differences, and Independence of Types of Effects," Organizational Behavior and Human Decision Processes, Elsevier, vol. 88(1), pages 411-429, May.
    7. Jingjun (David) Xu & Izak Benbasat & Ronald T. Cenfetelli, 2014. "Research Note ---The Influences of Online Service Technologies and Task Complexity on Efficiency and Personalization," Information Systems Research, INFORMS, vol. 25(2), pages 420-436, June.
    8. Gerald Häubl & Valerie Trifts, 2000. "Consumer Decision Making in Online Shopping Environments: The Effects of Interactive Decision Aids," Marketing Science, INFORMS, vol. 19(1), pages 4-21, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xiaohui Zhang & Qianzhou Du & Zhongju Zhang, 2022. "A theory‐driven machine learning system for financial disinformation detection," Production and Operations Management, Production and Operations Management Society, vol. 31(8), pages 3160-3179, August.
    2. Ni Huang & Probal Mojumder & Tianshu Sun & Jinchi Lv & Joseph M. Golden, 2021. "Not Registered? Please Sign Up First: A Randomized Field Experiment on the Ex Ante Registration Request," Information Systems Research, INFORMS, vol. 32(3), pages 914-931, September.
    3. Ross Niswanger & Eric Walden, 2022. "Quantity bias in comparison-shopping of multi-item baskets," PLOS ONE, Public Library of Science, vol. 17(2), pages 1-19, February.
    4. Lusi Li & Jianqing Chen & Srinivasan Raghunathan, 2018. "Recommender System Rethink: Implications for an Electronic Marketplace with Competing Manufacturers," Information Systems Research, INFORMS, vol. 29(4), pages 1003-1023, December.
    5. Ni Huang & Tianshu Sun & Peiyu Chen & Joseph M. Golden, 2019. "Word-of-Mouth System Implementation and Customer Conversion: A Randomized Field Experiment," Information Systems Research, INFORMS, vol. 30(3), pages 805-818, September.
    6. Weiquan Wang & Jingjun (David) Xu & May Wang, 2018. "Effects of Recommendation Neutrality and Sponsorship Disclosure on Trust vs. Distrust in Online Recommendation Agents: Moderating Role of Explanations for Organic Recommendations," Management Science, INFORMS, vol. 64(11), pages 5198-5219, November.
    7. Weiquan Wang & May Wang, 2019. "Effects of Sponsorship Disclosure on Perceived Integrity of Biased Recommendation Agents: Psychological Contract Violation and Knowledge-Based Trust Perspectives," Information Systems Research, INFORMS, vol. 30(2), pages 507-522, June.
    8. Huang, Chao & Ding, Yi & Hu, Weihao & Jiang, Yi & Li, Yongzhen, 2021. "Cost-Based attraction recommendation for tour operators under stochastic demand," Omega, Elsevier, vol. 102(C).
    9. Ekaterina Jussupow & Kai Spohrer & Armin Heinzl & Joshua Gawlitza, 2021. "Augmenting Medical Diagnosis Decisions? An Investigation into Physicians’ Decision-Making Process with Artificial Intelligence," Information Systems Research, INFORMS, vol. 32(3), pages 713-735, September.
    10. Kevin Bauer & Andrej Gill, 2024. "Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies," Information Systems Research, INFORMS, vol. 35(1), pages 226-248, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laure Kuhfuss & Raphaële Préget & Sophie Thoyer & Nick Hanley & Philippe Le Coent & Mathieu Désolé, 2016. "Nudges, Social Norms, and Permanence in Agri-environmental Schemes," Land Economics, University of Wisconsin Press, vol. 92(4), pages 641-655.
    2. Todd McElroy & David L. Dickinson & Irwin P. Levin, 2019. "Thinking About Decisions: An Integrative Approach of Person and Task Factors," Working Papers 19-04, Department of Economics, Appalachian State University.
    3. Van de Velde, Liesbeth & Verbeke, Wim & Popp, Michael & Van Huylenbroeck, Guido, 2010. "The importance of message framing for providing information about sustainability and environmental aspects of energy," Energy Policy, Elsevier, vol. 38(10), pages 5541-5549, October.
    4. Yang Li & Dandan Yang & Yingying Liu, 2021. "The Effect of Message Framing on Consumers’ Intentions to Purchase Recycling-Aiding Products in China," Sustainability, MDPI, vol. 13(12), pages 1-17, June.
    5. Fengchun Tang, 2020. "The more interactivity the better? Investigating interactivity, task complexity, and product knowledge in online purchase decisions," Information Technology and Management, Springer, vol. 21(3), pages 179-189, September.
    6. Freling, Traci H. & Vincent, Leslie H. & Henard, David H., 2014. "When not to accentuate the positive: Re-examining valence effects in attribute framing," Organizational Behavior and Human Decision Processes, Elsevier, vol. 124(2), pages 95-109.
    7. Krishnamoorthy, Ganesh & Maroney, James J. & Ó hÓgartaigh, Ciarán, 2008. "20-F reconciliations and investment recommendations by financial professionals," Journal of Business Research, Elsevier, vol. 61(4), pages 355-362, April.
    8. Kuvaas, Bard & Selart, Marcus, 2004. "Effects of attribute framing on cognitive processing and evaluation," Organizational Behavior and Human Decision Processes, Elsevier, vol. 95(2), pages 198-207, November.
    9. Klaus Abbink & Heike Hennig-Schmidt, 2006. "Neutral versus loaded instructions in a bribery experiment," Experimental Economics, Springer;Economic Science Association, vol. 9(2), pages 103-121, June.
    10. Gelbrich, Katja & Schröder, Eva-Maria, 2008. "Werbewirkung von Furchtappellen: Stand der Forschung," Ilmenauer Schriften zur Betriebswirtschaftslehre, Technische Universität Ilmenau, Institut für Betriebswirtschaftslehre, volume 2, number 22008.
    11. Zhang, Hong & Zhao, Ling & Gupta, Sumeet, 2018. "The role of online product recommendations on customer decision making and loyalty in social shopping communities," International Journal of Information Management, Elsevier, vol. 38(1), pages 150-166.
    12. Yi-Fen Chen & Shi-Han Chang, 2016. "The online framing effect: the moderating role of warning, brand familiarity, and product type," Electronic Commerce Research, Springer, vol. 16(3), pages 355-374, September.
    13. Key Pousttchi & Maik Dehnert, 2018. "Exploring the digitalization impact on consumer decision-making in retail banking," Electronic Markets, Springer;IIM University of St. Gallen, vol. 28(3), pages 265-286, August.
    14. Alexander, Phyllis & Balavac-Orlic, Merima, 2022. "Tax morale: Framing and fairness," Economic Systems, Elsevier, vol. 46(1).
    15. Cullis, John & Jones, Philip & Lewis, Alan, 2006. "Tax framing, Instrumentality and individual differences: Are there two different cultures?," Journal of Economic Psychology, Elsevier, vol. 27(2), pages 304-320, April.
    16. Breugelmans, Els & Köhler, Clemens F. & Dellaert, Benedict G.C. & de Ruyter, Ko, 2012. "Promoting Interactive Decision Aids on Retail Websites: A Message Framing Perspective with New versus Traditional Focal Actions," Journal of Retailing, Elsevier, vol. 88(2), pages 226-235.
    17. Kim, Jungkeun & Kim, Jae-Eun & Marshall, Roger, 2014. "Search for the underlying mechanism of framing effects in multi-alternative and multi-attribute decision situations," Journal of Business Research, Elsevier, vol. 67(3), pages 378-385.
    18. Gilberto Montibeller & Detlof von Winterfeldt, 2015. "Cognitive and Motivational Biases in Decision and Risk Analysis," Risk Analysis, John Wiley & Sons, vol. 35(7), pages 1230-1251, July.
    19. Dharshing, Samdruk & Hille, Stefanie Lena & Wüstenhagen, Rolf, 2017. "The Influence of Political Orientation on the Strength and Temporal Persistence of Policy Framing Effects," Ecological Economics, Elsevier, vol. 142(C), pages 295-305.
    20. Ellen Peters & Irwin P. Levin, 2008. "Dissecting the risky-choice framing effect: Numeracy as an individual-difference factor in weighting risky and riskless options," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 3(6), pages 435-448, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:orisre:v:26:y:2015:i:4:p:793-811. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.