IDEAS home Printed from https://ideas.repec.org/p/zbw/cbscwp/336742.html

The price of advice: Experimental evidence on the effects of AI recommenders

Author

Listed:
  • Zac, Amit
  • Gal, Michal S.

Abstract

The integration of large language models (LLMs) into recommender systems (RS) has given rise to a new generation of Conversational RS (CRS). This study asks how CRS systems shape consumer behavior, and, in particular, their spending. Despite the rapid proliferation of such systems, including widely used tools like OpenAI's ChatGPT and Google's Gemini, we still lack evidence on their behavioral effects. This study provides the first controlled empirical test of CRS influence on real purchasing decisions. In a laboratory experiment, complemented by large-scale API studies, participants were randomly assigned to one of four conditions: a traditional search baseline, GPT, Gemini, or a customized GPT designed to steer users toward more expensive products. CRS consistently increase consumer expenditures, with Customized GPT producing the highest average spending. Importantly, these effects are not driven by differences in perceived product quality, prior shopping experience, or generalized trust. Rather, they stem from subtle linguistic framing and increased exposure to premium brands. Taken together, the findings position LLM-based CRS as novel and potent choice architects with downstream implications for consumer protection, market design, and regulatory oversight.

Suggested Citation

  • Zac, Amit & Gal, Michal S., 2025. "The price of advice: Experimental evidence on the effects of AI recommenders," Working Papers 375, The University of Chicago Booth School of Business, George J. Stigler Center for the Study of the Economy and the State.
  • Handle: RePEc:zbw:cbscwp:336742
    as

    Download full text from publisher

    File URL: https://www.econstor.eu/bitstream/10419/336742/1/194960134X.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Nelson, Philip, 1974. "Advertising as Information," Journal of Political Economy, University of Chicago Press, vol. 82(4), pages 729-754, July/Aug..
    2. Amelia Fletcher & Peter L Ormosi & Rahul Savani, 2023. "Recommender Systems and Supplier Competition on Platforms," Journal of Competition Law and Economics, Oxford University Press, vol. 19(3), pages 397-426.
    3. Amos Tversky & Itamar Simonson, 1993. "Context-Dependent Preferences," Management Science, INFORMS, vol. 39(10), pages 1179-1189, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kyle Bagwell & Garey Ramey, 1988. "Advertising and Limit Pricing," RAND Journal of Economics, The RAND Corporation, vol. 19(1), pages 59-71, Spring.
    2. Del Barrio-García, Salvador & Kamakura, Wagner A. & Luque-Martínez, Teodoro, 2019. "A Longitudinal Cross-product Analysis of Media-budget Allocations: How Economic and Technological Disruptions Affected Media Choices Across Industries," Journal of Interactive Marketing, Elsevier, vol. 45(C), pages 1-15.
    3. Thunström, Linda & Nordström, Jonas & Shogren, Jason F., 2015. "Certainty and overconfidence in future preferences for food," Journal of Economic Psychology, Elsevier, vol. 51(C), pages 101-113.
    4. J. K. Pappalardo, 2022. "Economics of Consumer Protection: Contributions and Challenges in Estimating Consumer Injury and Evaluating Consumer Protection Policy," Journal of Consumer Policy, Springer, vol. 45(2), pages 201-238, June.
    5. repec:ebl:ecbull:v:10:y:2004:i:8:p:1-8 is not listed on IDEAS
    6. Dhaval M. Dave, 2013. "Effects of Pharmaceutical Promotion: A Review and Assessment," NBER Working Papers 18830, National Bureau of Economic Research, Inc.
    7. Eunae Jung & Hyungun Sung, 2017. "The Influence of the Middle East Respiratory Syndrome Outbreak on Online and Offline Markets for Retail Sales," Sustainability, MDPI, vol. 9(3), pages 1-23, March.
    8. Fabio FIORILLO & Marco LILLA & Stefano STAFFOLANI, 2013. "Advertising Has Got You On The Run. Well-Being, Consumption and Leisure in a GE model," Working Papers 389, Universita' Politecnica delle Marche (I), Dipartimento di Scienze Economiche e Sociali.
    9. Moore, Don A., 1999. "Order Effects in Preference Judgments: Evidence for Context Dependence in the Generation of Preferences, ," Organizational Behavior and Human Decision Processes, Elsevier, vol. 78(2), pages 146-165, May.
    10. Hattori, Keisuke & Higashida, Keisaku, 2014. "Misleading advertising and minimum quality standards," Information Economics and Policy, Elsevier, vol. 28(C), pages 1-14.
    11. Michelle Haynes & Steve Thompson, 2012. "The Economic Significance of User-Generated Feedback," International Journal of the Economics of Business, Taylor & Francis Journals, vol. 19(1), pages 153-166, February.
    12. Suwelack, Thomas & Hogreve, Jens & Hoyer, Wayne D., 2011. "Understanding Money-Back Guarantees: Cognitive, Affective, and Behavioral Outcomes," Journal of Retailing, Elsevier, vol. 87(4), pages 462-478.
    13. Chadwick J. Miller & Daniel C. Brannon & Jim Salas & Martha Troncoza, 2021. "Advertising, incentives, and the upsell: how advertising differentially moderates customer- vs. retailer-directed price incentives’ impact on consumers’ preferences for premium products," Journal of the Academy of Marketing Science, Springer, vol. 49(6), pages 1043-1064, November.
    14. Flores, Alvaro & Berbeglia, Gerardo & Van Hentenryck, Pascal, 2019. "Assortment optimization under the Sequential Multinomial Logit Model," European Journal of Operational Research, Elsevier, vol. 273(3), pages 1052-1064.
    15. Christoph Engel, 2006. "The Difficult Reception of Rigorous Descriptive Social Science in the Law," Discussion Paper Series of the Max Planck Institute for Behavioral Economics 2006_1, Max Planck Institute for Behavioral Economics.
    16. Aslan, Hadiye & Kumar, Praveen, 2016. "The product market effects of hedge fund activism," Journal of Financial Economics, Elsevier, vol. 119(1), pages 226-248.
    17. Ascensión Andina‐Díaz & Javier Campos & Juan‐Luis Jiménez & Jordi Perdiguero, 2024. "Strategic advertising in the aftermath of a corporate scandal," Manchester School, University of Manchester, vol. 92(6), pages 663-699, December.
    18. Kazagli, Evanthia & de Lapparent, Matthieu, 2023. "A discrete choice modeling framework of heterogenous decision rules accounting for non-trading behavior," Journal of choice modelling, Elsevier, vol. 48(C).
    19. Pracejus, John W. & O'Guinn, Thomas C. & Olsen, G. Douglas, 2013. "When white space is more than “burning money”: Economic signaling meets visual commercial rhetoric," International Journal of Research in Marketing, Elsevier, vol. 30(3), pages 211-218.
    20. Xujin Pu & Huanzhen Zhang, 2016. "Voluntary Certification of Agricultural Products in Competitive Markets: The Consideration of Boundedly Rational Consumers," Sustainability, MDPI, vol. 8(9), pages 1-13, September.
    21. Jonathan C. Pettibone, 2012. "Testing the effect of time pressure on asymmetric dominance and compromise decoys in choice," Judgment and Decision Making, Society for Judgment and Decision Making, vol. 7(4), pages 513-523, July.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:zbw:cbscwp:336742. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: ZBW - Leibniz Information Centre for Economics (email available below). General contact details of provider: https://edirc.repec.org/data/gsuchus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.