IDEAS home Printed from https://ideas.repec.org/a/eee/joreco/v75y2023ics0969698923002412.html
   My bibliography  Save this article

Decisions with ChatGPT: Reexamining choice overload in ChatGPT recommendations

Author

Listed:
  • Kim, Jungkeun
  • Kim, Jeong Hyun
  • Kim, Changju
  • Park, Jooyoung

Abstract

This research examines how individuals respond differently to recommendation options generated by ChatGPT, an AI-powered language model, in five studies. In contrast to previous research on choice overload, Studies 1 and 2 demonstrate that people tend to respond positively to a large number of recommendation options (60 options), revealing diverse consumer perceptions of AI-generated recommendations. Studies 3 and 4 further illustrate the moderating effect of recommendation agents and indicate that choice overload elicits distinct patterns of consumer reactions depending on whether the recommendations are from a human or AI agent. Lastly, Study 5 directly measures consumer preferences for recommendation agents, revealing a general preference for ChatGPT, particularly when a large number of options are available. These findings have significant implications for recommendation system design and user preferences regarding AI-powered recommendations.

Suggested Citation

  • Kim, Jungkeun & Kim, Jeong Hyun & Kim, Changju & Park, Jooyoung, 2023. "Decisions with ChatGPT: Reexamining choice overload in ChatGPT recommendations," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    • Handle: RePEc:eee:joreco:v:75:y:2023:i:c:s0969698923002412
    DOI: 10.1016/j.jretconser.2023.103494
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0969698923002412
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jretconser.2023.103494?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Benjamin Scheibehenne & Rainer Greifeneder & Peter M. Todd, 2010. "Can There Ever Be Too Many Options? A Meta-Analytic Review of Choice Overload," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 37(3), pages 409-425, October.
    2. Hu, Qian & Pan, Zhao, 2023. "Can AI benefit individual resilience? The mediation roles of AI routinization and infusion," Journal of Retailing and Consumer Services, Elsevier, vol. 73(C).
    3. Park, Jeong-Yeol & Jang, SooCheong (Shawn), 2013. "Confused by too many choices? Choice overload in tourism," Tourism Management, Elsevier, vol. 35(C), pages 1-12.
    4. Erik Hermann, 2022. "Anthropomorphized artificial intelligence, attachment, and consumer behavior," Marketing Letters, Springer, vol. 33(1), pages 157-162, March.
    5. Shiri Melumad & Rhonda Hadi & Christian Hildebrand & Adrian F. Ward, 2020. "Technology-Augmented Choice: How Digital Innovations Are Transforming Consumer Decision Processes," Customer Needs and Solutions, Springer;Institute for Sustainable Innovation and Growth (iSIG), vol. 7(3), pages 90-101, October.
    6. Mittal, Banwari, 2016. "The maximizing consumer wants even more choices: How consumers cope with the marketplace of overchoice," Journal of Retailing and Consumer Services, Elsevier, vol. 31(C), pages 361-370.
    7. Aksoy, Lerzan & Cooil, Bruce & Lurie, Nicholas H., 2011. "Decision Quality Measures in Recommendation Agents Research," Journal of Interactive Marketing, Elsevier, vol. 25(2), pages 110-122.
    8. Jan, Ihsan Ullah & Ji, Seonggoo & Kim, Changju, 2023. "What (de) motivates customers to use AI-powered conversational agents for shopping? The extended behavioral reasoning perspective," Journal of Retailing and Consumer Services, Elsevier, vol. 75(C).
    9. Juran Kim, 2020. "The influence of perceived costs and perceived benefits on AI-driven interactive recommendation agent value," Journal of Global Scholars of Marketing Science, Taylor & Francis Journals, vol. 30(3), pages 319-333, July.
    10. Filieri, Raffaele, 2015. "What makes online reviews helpful? A diagnosticity-adoption framework to explain informational and normative influences in e-WOM," Journal of Business Research, Elsevier, vol. 68(6), pages 1261-1270.
    11. Ruan, Yanya & Mezei, József, 2022. "When do AI chatbots lead to higher customer satisfaction than human frontline employees in online shopping assistance? Considering product attribute type," Journal of Retailing and Consumer Services, Elsevier, vol. 68(C).
    12. Alexander Chernev, 2006. "Decision Focus and Consumer Choice among Assortments," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 33(1), pages 50-59, June.
    13. William J. Baumol & Edward A. Ide, 1956. "Variety in Retailing," Management Science, INFORMS, vol. 3(1), pages 93-101, October.
    14. Chris Stokel-Walker & Richard Van Noorden, 2023. "What ChatGPT and generative AI mean for science," Nature, Nature, vol. 614(7947), pages 214-216, February.
    15. Aner Sela & Jonah Berger & Wendy Liu, 2009. "Variety, Vice, and Virtue: How Assortment Size Influences Option Choice," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 35(6), pages 941-951, April.
    16. Sylvie Borau & Tobias Otterbring & Sandra Laporte & Samuel Fosso Wamba, 2021. "The most human bot: Female gendering increases humanness perceptions of bots and acceptance of AI," Post-Print hal-03648092, HAL.
    17. Kumari, Rashmi & Tatavarthy, Aruna Divya & Sahay, Arvind, 2022. "Too many cooks spoil the broth? Number of promotional gifts and impact on consumer choice," Journal of Retailing and Consumer Services, Elsevier, vol. 69(C).
    18. Ketron, Seth & Spears, Nancy & Dai, Bo, 2016. "Overcoming information overload in retail environments: Imagination and sales promotion in a wine context," Journal of Retailing and Consumer Services, Elsevier, vol. 33(C), pages 23-32.
    19. Greenleaf, Eric A & Lehmann, Donald R, 1995. "Reasons for Substantial Delay in Consumer Decision Making," Journal of Consumer Research, Journal of Consumer Research Inc., vol. 22(2), pages 186-199, September.
    20. Chinchanachokchai, Sydney & Thontirawong, Pipat & Chinchanachokchai, Punjaporn, 2021. "A tale of two recommender systems: The moderating role of consumer expertise on artificial intelligence based product recommendations," Journal of Retailing and Consumer Services, Elsevier, vol. 61(C).
    21. Raffaella Misuraca & Francesco Ceresia & Ursina Teuscher & Palmira Faraci, 2019. "The Role of the Brand on Choice Overload," Mind & Society: Cognitive Studies in Economics and Social Sciences, Springer;Fondazione Rosselli, vol. 18(1), pages 57-76, June.
    22. Ahn, Jungyong & Kim, Jungwon & Sung, Yongjun, 2022. "The effect of gender stereotypes on artificial intelligence recommendations," Journal of Business Research, Elsevier, vol. 141(C), pages 50-59.
    23. Zuiderveen Borgesius, Frederik J. & Trilling, Damian & Möller, Judith & Bodó, Balázs & de Vreese, Claes H. & Helberger, Natali, 2016. "Should we worry about filter bubbles?," Internet Policy Review: Journal on Internet Regulation, Alexander von Humboldt Institute for Internet and Society (HIIG), Berlin, vol. 5(1), pages 1-16.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Thai, Nguyen T. & Yuksel, Ulku, 2017. "Too many destinations to visit: Tourists’ dilemma?," Annals of Tourism Research, Elsevier, vol. 62(C), pages 38-53.
    2. Spassova, Gerri & Isen, Alice M., 2013. "Positive affect moderates the impact of assortment size on choice satisfaction," Journal of Retailing, Elsevier, vol. 89(4), pages 397-408.
    3. Blakeley B. McShane & Ulf Böckenholt, 2018. "Multilevel Multivariate Meta-analysis with Application to Choice Overload," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 255-271, March.
    4. Georgios Gerasimou, 2016. "Asymmetric dominance, deferral, and status quo bias in a behavioral model of choice," Theory and Decision, Springer, vol. 80(2), pages 295-312, February.
    5. Aydinli, Aylin & Gu, Yangjie & Pham, Michel Tuan, 2017. "An experience-utility explanation of the preference for larger assortments," International Journal of Research in Marketing, Elsevier, vol. 34(3), pages 746-760.
    6. Jonah Berger & Michaela Draganska & Itamar Simonson, 2007. "The Influence of Product Variety on Brand Perception and Choice," Marketing Science, INFORMS, vol. 26(4), pages 460-472, 07-08.
    7. Kim, Jikyung (Jeanne) & Kim, Sanghwa & Choi, Jeonghye, 2020. "Purchase now and consume later: Do online and offline environments drive online social interactions and sales?," Journal of Business Research, Elsevier, vol. 120(C), pages 274-285.
    8. Orth, Ulrich R. & Crouch, Roberta C., 2014. "Is Beauty in the Aisles of the Retailer? Package Processing in Visually Complex Contexts," Journal of Retailing, Elsevier, vol. 90(4), pages 524-537.
    9. Andrew E. Reed & Joseph A. Mikels & Corinna E. Lockenhoff, 2012. "Choosing with confidence: Self-efficacy and preferences for choice," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 7(2), pages 173-180, March.
    10. Peter Gordon Roetzel, 2019. "Information overload in the information age: a review of the literature from business administration, business psychology, and related disciplines with a bibliometric approach and framework developmen," Business Research, Springer;German Academic Association for Business Research, vol. 12(2), pages 479-522, December.
    11. Tom Fangyun Tan & Serguei Netessine & Lorin Hitt, 2017. "Is Tom Cruise Threatened? An Empirical Study of the Impact of Product Variety on Demand Concentration," Information Systems Research, INFORMS, vol. 28(3), pages 643-660, September.
    12. Mark Heitmann & Andreas Herrmann & Christian Kaiser, 2007. "The effect of product variety on purchase probability," Review of Managerial Science, Springer, vol. 1(2), pages 111-131, August.
    13. Pascoe, Sean & Doshi, Amar & Kovac, Mladen & Austin, Angelica, 2019. "Estimating coastal and marine habitat values by combining multi-criteria methods with choice experiments," Ecosystem Services, Elsevier, vol. 38(C), pages 1-1.
    14. Yan, Huan & Chang, En-Chung & Chou, Ting-Jui & Tang, Xiaofei, 2015. "The over-categorization effect: How the number of categorizations influences shoppers' perceptions of variety and satisfaction," Journal of Business Research, Elsevier, vol. 68(3), pages 631-638.
    15. repec:cup:judgdm:v:12:y:2017:i:3:p:198-207 is not listed on IDEAS
    16. Sands, Sean & Maggioni, Isabella & Ferraro, Carla & Jebarajakirthy, Charles & Dharmesti, Maria, 2019. "The vice and virtue of on-the-go consumption: An exploratory segmentation," Journal of Retailing and Consumer Services, Elsevier, vol. 51(C), pages 399-408.
    17. Ketron, Seth & Spears, Nancy, 2019. "Sounds like a heuristic! Investigating the effect of sound-symbolic correspondences between store names and sizes on consumer willingness-to-pay," Journal of Retailing and Consumer Services, Elsevier, vol. 51(C), pages 285-292.
    18. Pizzi, Gabriele & Scarpi, Daniele, 2013. "When Out-of-Stock Products DO Backfire: Managing Disclosure Time and Justification Wording," Journal of Retailing, Elsevier, vol. 89(3), pages 352-359.
    19. repec:cup:judgdm:v:7:y:2012:i:2:p:173-180 is not listed on IDEAS
    20. Ludovik Coba & Laurens Rook & Markus Zanker, 2020. "Choosing between hotels: impact of bimodal rating summary statistics and maximizing behavioral tendency," Information Technology & Tourism, Springer, vol. 22(1), pages 167-186, March.
    21. Michal Maimaran, 2017. "To increase engagement, offer less: The effect of assortment size on children’s engagement," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 12(3), pages 198-207, May.
    22. Baulcomb, Corinne & Fletcher, Ruth & Lewis, Amy & Akoglu, Ekin & Robinson, Leonie & von Almen, Amanda & Hussain, Salman & Glenk, Klaus, 2015. "A pathway to identifying and valuing cultural ecosystem services: An application to marine food webs," Ecosystem Services, Elsevier, vol. 11(C), pages 128-139.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:joreco:v:75:y:2023:i:c:s0969698923002412. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/journal-of-retailing-and-consumer-services .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.