IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2510.12049.html

Generative AI and Sales Productivity: Field Experiments in Online Retail

Author

Listed:
  • Lu Fang
  • Zhe Yuan
  • Kaifu Zhang
  • Dante Donati
  • Miklos Sarvary

Abstract

We quantify the short-term impact of Generative Artificial Intelligence (GenAI) on sales performance through a series of large-scale randomized field experiments involving millions of users and products at a leading cross-border online retail platform. Over 2023-2024, the platform integrated GenAI into seven business workflows spanning customer service, consumer-product matching, advertising, and seller services. We find that GenAI adoption increases sales in most workflows, with effects ranging from no detectable impact to $16.3\%$, depending on GenAI's marginal contribution relative to baseline firm practices. Across the four GenAI applications with positive sales effects, the implied annual incremental value is roughly $\$5$ per consumer$-$an economically meaningful impact given the retailer's scale and the early stage of GenAI adoption. The gains operate primarily through higher conversion rates rather than larger cart values, consistent with GenAI improving the shopping experience by reducing search, information, communication, and personalization frictions. Importantly, these effects are not associated with worse post-purchase outcomes, as product return rates and customer ratings do not deteriorate. Finally, we document substantial demand-side heterogeneity, with larger gains for less experienced consumers. Our findings provide novel, large-scale causal evidence on how GenAI shapes sales productivity in online retail, highlighting both its immediate value and broader potential.

Suggested Citation

  • Lu Fang & Zhe Yuan & Kaifu Zhang & Dante Donati & Miklos Sarvary, 2025. "Generative AI and Sales Productivity: Field Experiments in Online Retail," Papers 2510.12049, arXiv.org, revised Jun 2026.
  • Handle: RePEc:arx:papers:2510.12049
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2510.12049
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Daron Acemoglu, 2025. "The simple macroeconomics of AI," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 40(121), pages 13-58.
    2. Yuxin Chen & Song Yao, 2017. "Sequential Search with Refinement: Model and Application with Click-Stream Data," Management Science, INFORMS, vol. 63(12), pages 4345-4365, December.
    3. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2019. "Modeling Consumer Footprints on Search Engines: An Interplay with Social Media," Management Science, INFORMS, vol. 65(3), pages 1363-1385, March.
    4. Belleflamme, Paul & Peitz, Martin, 2021. "The Economics of Platforms : Concepts and Strategy," LIDAM Reprints CORE 3185, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    5. Thomas Blake & Chris Nosko & Steven Tadelis, 2015. "Consumer Heterogeneity and Paid Search Effectiveness: A Large‐Scale Field Experiment," Econometrica, Econometric Society, vol. 83, pages 155-174, January.
    6. Ann Bartel & Casey Ichniowski & Kathryn Shaw, 2007. "How Does Information Technology Affect Productivity? Plant-Level Comparisons of Product Innovation, Process Improvement, and Worker Skills," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 122(4), pages 1721-1758.
    7. Paul R. Milgrom & Steven Tadelis, 2018. "How Artificial Intelligence and Machine Learning Can Impact Market Design," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 567-585, National Bureau of Economic Research, Inc.
    8. Avi Goldfarb & Catherine Tucker, 2011. "Rejoinder--Implications of "Online Display Advertising: Targeting and Obtrusiveness"," Marketing Science, INFORMS, vol. 30(3), pages 413-415, 05-06.
    9. Kathryn Bonney & Cory Breaux & Cathy Buffington & Emin Dinlersoz & Lucia S. Foster & Nathan Goldschlag & John C. Haltiwanger & Zachary Kroff & Keith Savage, 2024. "Tracking Firm Use of AI in Real Time: A Snapshot from the Business Trends and Outlook Survey," NBER Working Papers 32319, National Bureau of Economic Research, Inc.
    10. Li, Yinan & Liu, Ying & Yu, Muran, 2025. "Consumer segmentation with large language models," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    11. Hartmann, Jochen & Exner, Yannick & Domdey, Samuel, 2025. "The power of generative marketing: Can generative AI create superhuman visual marketing content?," International Journal of Research in Marketing, Elsevier, vol. 42(1), pages 13-31.
    12. Chris Gu & Yike Wang, 2022. "Consumer Online Search with Partially Revealed Information," Management Science, INFORMS, vol. 68(6), pages 4215-4235, June.
    13. Raluca M. Ursu, 2018. "The Power of Rankings: Quantifying the Effect of Rankings on Online Consumer Search and Purchase Decisions," Marketing Science, INFORMS, vol. 37(4), pages 530-552, August.
    14. Tianshu Sun & Zhe Yuan & Chunxiao Li & Kaifu Zhang & Jun Xu, 2024. "The Value of Personal Data in Internet Commerce: A High-Stakes Field Experiment on Data Regulation Policy," Management Science, INFORMS, vol. 70(4), pages 2645-2660, April.
    15. Fan, Ying & Ju, Jiandong & Xiao, Mo, 2016. "Reputation premium and reputation management: Evidence from the largest e-commerce platform in China," International Journal of Industrial Organization, Elsevier, vol. 46(C), pages 63-76.
    16. Avi Goldfarb & Catherine Tucker, 2011. "Online Display Advertising: Targeting and Obtrusiveness," Marketing Science, INFORMS, vol. 30(3), pages 389-404, 05-06.
    17. Huanxing Yang, 2013. "Targeted search and the long tail effect," RAND Journal of Economics, RAND Corporation, vol. 44(4), pages 733-756, December.
    18. Bingchen Liu & Yuanyuan Fang & Naixing Xu & Shihao Hou & Xin Li & Qian Li, 2025. "Large Language Models for Knowledge Graph Embedding: A Survey," Mathematics, MDPI, vol. 13(14), pages 1-28, July.
    19. Luís Cabral & Ali Hortaçsu, 2010. "The Dynamics Of Seller Reputation: Evidence From Ebay," Journal of Industrial Economics, Wiley Blackwell, vol. 58(1), pages 54-78, March.
    20. Chad Syverson, 2011. "What Determines Productivity?," Journal of Economic Literature, American Economic Association, vol. 49(2), pages 326-365, June.
    21. Zenan Chen & Jason Chan, 2024. "Large Language Model in Creative Work: The Role of Collaboration Modality and User Expertise," Management Science, INFORMS, vol. 70(12), pages 9101-9117, December.
    22. Erik Brynjolfsson & Yu (Jeffrey) Hu & Duncan Simester, 2011. "Goodbye Pareto Principle, Hello Long Tail: The Effect of Search Costs on the Concentration of Product Sales," Management Science, INFORMS, vol. 57(8), pages 1373-1386, August.
    23. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The Skill Content of Recent Technological Change: An Empirical Exploration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1279-1333.
    24. Anuj Kapoor & Madhav Kumar, 2025. "Frontiers: Generative AI and Personalized Video Advertisements," Marketing Science, INFORMS, vol. 44(4), pages 733-747, July.
    25. Dirk Bergemann & Alessandro Bonatti, 2011. "Targeting in advertising markets: implications for offline versus online media," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 417-443, September.
    26. Elisabeth Honka, 2014. "Quantifying search and switching costs in the US auto insurance industry," RAND Journal of Economics, RAND Corporation, vol. 45(4), pages 847-884, December.
    27. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2025. "Generative AI at Work," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(2), pages 889-942.
    28. Hema Yoganarasimhan, 2020. "Search Personalization Using Machine Learning," Management Science, INFORMS, vol. 66(3), pages 1045-1070, March.
    29. Jan De Loecker, 2011. "Product Differentiation, Multiproduct Firms, and Estimating the Impact of Trade Liberalization on Productivity," Econometrica, Econometric Society, vol. 79(5), pages 1407-1451, September.
    30. Anders Humlum & Emilie Vestergaard, 2025. "Still Waters, Rapid Currents: Early Labor Market Transformation under Generative AI," NBER Working Papers 33777, National Bureau of Economic Research, Inc.
    31. Flavio Calvino & Jelmer Reijerink & Lea Samek, 2025. "The effects of generative AI on productivity, innovation and entrepreneurship," OECD Artificial Intelligence Papers 39, OECD Publishing.
    32. Joonhyuk Yang & Navdeep S. Sahni & Harikesh S. Nair & Xi Xiong, 2024. "Advertising as Information for Ranking E-Commerce Search Listings," Marketing Science, INFORMS, vol. 43(2), pages 360-377, March.
    33. Jiafeng Chen & Jonathan Roth, 2024. "Logs with Zeros? Some Problems and Solutions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(2), pages 891-936.
    34. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue nov.
    35. Michael Dinerstein & Liran Einav & Jonathan Levin & Neel Sundaresan, 2018. "Consumer Price Search and Platform Design in Internet Commerce," American Economic Review, American Economic Association, vol. 108(7), pages 1820-1859, July.
    36. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    37. Jens-Uwe Franck & Martin Peitz, 2021. "Market Definition in the Platform Economy," CRC TR 224 Discussion Paper Series crctr224_2021_259v2, University of Bonn and University of Mannheim, Germany.
    38. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    39. Wei Zhou & Mingfeng Lin & Mo Xiao & Lu Fang, 2025. "Higher Precision Is Not Always Better: Search Algorithm and Consumer Engagement," Management Science, INFORMS, vol. 71(7), pages 6204-6226, July.
    40. Gu, Chris & Wang, Yike, 2022. "Consumer online search with partially revealed information," LSE Research Online Documents on Economics 109871, London School of Economics and Political Science, LSE Library.
    41. Belleflamme,Paul & Peitz,Martin, 2021. "The Economics of Platforms," Cambridge Books, Cambridge University Press, number 9781108710749, August.
    42. Chris Nosko & Steven Tadelis, 2015. "The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment," NBER Working Papers 20830, National Bureau of Economic Research, Inc.
    43. Steven Tadelis, 2016. "Reputation and Feedback Systems in Online Platform Markets," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 321-340, October.
    44. Daron Acemoglu & Pascual Restrepo, 2018. "Low-Skill and High-Skill Automation," Journal of Human Capital, University of Chicago Press, vol. 12(2), pages 204-232.
    45. Timothy F. Bresnahan & Erik Brynjolfsson & Lorin M. Hitt, 2002. "Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 339-376.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:ces:ceswps:_12201 is not listed on IDEAS
    2. Wei Zhou & Mingfeng Lin & Mo Xiao & Lu Fang, 2025. "Higher Precision Is Not Always Better: Search Algorithm and Consumer Engagement," Management Science, INFORMS, vol. 71(7), pages 6204-6226, July.
    3. Wei Zhou & Zidong Wang, 2020. "Competing for Search Traffic in Query Markets: Entry Strategy, Platform Design, and Entrepreneurship," Working Papers 20-12, NET Institute.
    4. Xiang Hui & Meng Liu & Raphael Thomadsen, 2022. "Quality Certificates Alleviate Consumer Aversion to Sponsored Search Advertising," CESifo Working Paper Series 9886, CESifo.
    5. Chenshuo Sun, 2025. "How Does Prepopulating Search Bars with Keywords Affect Online Consumer Behavior? A Field Experiment," Marketing Science, INFORMS, vol. 44(6), pages 1217-1231, November.
    6. Sun, Quan & Huang, Minjie, 2026. "Firm-level evidence on AI-driven output expansion and productivity in China," Socio-Economic Planning Sciences, Elsevier, vol. 103(C).
    7. Paul Belleflamme & Martin Peitz, 2018. "Inside the engine room of digital platforms: Reviews, ratings, and recommendations," CRC TR 224 Discussion Paper Series crctr224_2018_004, University of Bonn and University of Mannheim, Germany.
    8. Tianshu Sun & Zhe Yuan & Chunxiao Li & Kaifu Zhang & Jun Xu, 2024. "The Value of Personal Data in Internet Commerce: A High-Stakes Field Experiment on Data Regulation Policy," Management Science, INFORMS, vol. 70(4), pages 2645-2660, April.
    9. Gesche, Tobias, 2018. "Reference Price Shifts and Customer Antagonism: Evidence from Reviews for Online Auctions," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181650, Verein für Socialpolitik / German Economic Association.
    10. Van Reenen, John, 2011. "Does competition raise productivity through improving management quality?," International Journal of Industrial Organization, Elsevier, vol. 29(3), pages 306-316, May.
    11. Konstantins Benkovskis & Styliani Christodoulopoulou & Olegs Tkacevs, 2025. "Adaption of Digital Technologies: the Case of Latvian Firms," Discussion Papers 2025/01, Latvijas Banka.
    12. Alberto Bracci & Jorn Boehnke & Abeer ElBahrawy & Nicola Perra & Alexander Teytelboym & Andrea Baronchelli, 2021. "Macroscopic properties of buyer-seller networks in online marketplaces," Papers 2112.09065, arXiv.org, revised Apr 2022.
    13. Viete, Steffen & Erdsiek, Daniel, 2018. "Trust-based work time and the productivity effects of mobile information technologies in the workplace," ZEW Discussion Papers 18-013, ZEW - Leibniz Centre for European Economic Research.
    14. Barth, Erling & Davis, James C. & Freeman, Richard B. & McElheran, Kristina, 2023. "Twisting the demand curve: Digitalization and the older workforce," Journal of Econometrics, Elsevier, vol. 233(2), pages 443-467.
    15. Jesper Akesson & Robert Hahn & Robert Metcalfe & Manuel Monti-Nussbaum, 2025. "The Impact of Fake Reviews on Demand and Welfare," Framed Field Experiments 00821, The Field Experiments Website.
    16. Steffen, Nico & Wiewiorra, Lukas & Kroon, Peter, 2021. "Wettbewerb und Regulierung in der Plattform- und Datenökonomie," WIK Discussion Papers 481, WIK Wissenschaftliches Institut für Infrastruktur und Kommunikationsdienste GmbH.
    17. Yassine Lefouili & Leonardo Madio, 2022. "The economics of platform liability," European Journal of Law and Economics, Springer, vol. 53(3), pages 319-351, June.
    18. Hana Choi & Carl F. Mela, 2019. "Monetizing Online Marketplaces," Marketing Science, INFORMS, vol. 38(6), pages 948-972, November.
    19. Raluca Mihaela Ursu & Tülin Erdem & Qingliang Wang & Qianyun Zhang, 2024. "Prior Information and Consumer Search: Evidence from Eye Tracking," Management Science, INFORMS, vol. 70(12), pages 8685-8708, December.
    20. Rackowitz, Leonard & Haampland, Ola, 2025. "The sound of salience: How platform design impacts consumption," Information Economics and Policy, Elsevier, vol. 71(C).
    21. Viete, Steffen & Erdsiek, Daniel, 2020. "Mobile Information Technologies and Firm Performance: The Role of Employee Autonomy," Information Economics and Policy, Elsevier, vol. 51(C).

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2510.12049. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.