IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2510.12049.html
   My bibliography  Save this paper

Generative AI and Firm Productivity: Field Experiments in Online Retail

Author

Listed:
  • Lu Fang
  • Zhe Yuan
  • Kaifu Zhang
  • Dante Donati
  • Miklos Sarvary

Abstract

We quantify the impact of Generative Artificial Intelligence (GenAI) on firm productivity through a series of large-scale randomized field experiments involving millions of users and products at a leading cross-border online retail platform. Over six months in 2023-2024, GenAI-based enhancements were integrated into seven consumer-facing business workflows. We find that GenAI adoption significantly increases sales, with treatment effects ranging from $0\%$ to $16.3\%$, depending on GenAI's marginal contribution relative to existing firm practices. Because inputs and prices were held constant across experimental arms, these gains map directly into total factor productivity improvements. Across the four GenAI applications with positive effects, the implied annual incremental value is approximately $\$ 5$ per consumer-an economically meaningful impact given the retailer's scale and the early stage of GenAI adoption. The primary mechanism operates through higher conversion rates, consistent with GenAI reducing frictions in the marketplace and improving consumer experience. We also document substantial heterogeneity: smaller and newer sellers, as well as less experienced consumers, exhibit disproportionately larger gains. Our findings provide novel, large-scale causal evidence on the productivity effects of GenAI in online retail, highlighting both its immediate value and broader potential.

Suggested Citation

  • Lu Fang & Zhe Yuan & Kaifu Zhang & Dante Donati & Miklos Sarvary, 2025. "Generative AI and Firm Productivity: Field Experiments in Online Retail," Papers 2510.12049, arXiv.org, revised Oct 2025.
  • Handle: RePEc:arx:papers:2510.12049
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2510.12049
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2025. "Generative AI at Work," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(2), pages 889-942.
    2. Daron Acemoglu, 2025. "The simple macroeconomics of AI," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 40(121), pages 13-58.
    3. Yuxin Chen & Song Yao, 2017. "Sequential Search with Refinement: Model and Application with Click-Stream Data," Management Science, INFORMS, vol. 63(12), pages 4345-4365, December.
    4. Belleflamme, Paul & Peitz, Martin, 2021. "The Economics of Platforms : Concepts and Strategy," LIDAM Reprints CORE 3185, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    5. Dina Mayzlin & Yaniv Dover & Judith Chevalier, 2014. "Promotional Reviews: An Empirical Investigation of Online Review Manipulation," American Economic Review, American Economic Association, vol. 104(8), pages 2421-2455, August.
    6. Michael Dinerstein & Liran Einav & Jonathan Levin & Neel Sundaresan, 2018. "Consumer Price Search and Platform Design in Internet Commerce," American Economic Review, American Economic Association, vol. 108(7), pages 1820-1859, July.
    7. Paul R. Milgrom & Steven Tadelis, 2018. "How Artificial Intelligence and Machine Learning Can Impact Market Design," NBER Chapters, in: The Economics of Artificial Intelligence: An Agenda, pages 567-585, National Bureau of Economic Research, Inc.
    8. Jan De Loecker, 2011. "Product Differentiation, Multiproduct Firms, and Estimating the Impact of Trade Liberalization on Productivity," Econometrica, Econometric Society, vol. 79(5), pages 1407-1451, September.
    9. Daron Acemoglu & Pascual Restrepo, 2018. "Low-Skill and High-Skill Automation," Journal of Human Capital, University of Chicago Press, vol. 12(2), pages 204-232.
    10. Hartmann, Jochen & Exner, Yannick & Domdey, Samuel, 2025. "The power of generative marketing: Can generative AI create superhuman visual marketing content?," International Journal of Research in Marketing, Elsevier, vol. 42(1), pages 13-31.
    11. Tianshu Sun & Zhe Yuan & Chunxiao Li & Kaifu Zhang & Jun Xu, 2024. "The Value of Personal Data in Internet Commerce: A High-Stakes Field Experiment on Data Regulation Policy," Management Science, INFORMS, vol. 70(4), pages 2645-2660, April.
    12. Avi Goldfarb & Catherine Tucker, 2011. "Online Display Advertising: Targeting and Obtrusiveness," Marketing Science, INFORMS, vol. 30(3), pages 389-404, 05-06.
    13. Chad Syverson, 2011. "What Determines Productivity?," Journal of Economic Literature, American Economic Association, vol. 49(2), pages 326-365, June.
    14. Erik Brynjolfsson & Yu (Jeffrey) Hu & Duncan Simester, 2011. "Goodbye Pareto Principle, Hello Long Tail: The Effect of Search Costs on the Concentration of Product Sales," Management Science, INFORMS, vol. 57(8), pages 1373-1386, August.
    15. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The Skill Content of Recent Technological Change: An Empirical Exploration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1279-1333.
    16. Anuj Kapoor & Madhav Kumar, 2025. "Frontiers: Generative AI and Personalized Video Advertisements," Marketing Science, INFORMS, vol. 44(4), pages 733-747, July.
    17. Timothy F. Bresnahan & Erik Brynjolfsson & Lorin M. Hitt, 2002. "Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 339-376.
    18. Elisabeth Honka, 2014. "Quantifying search and switching costs in the US auto insurance industry," RAND Journal of Economics, RAND Corporation, vol. 45(4), pages 847-884, December.
    19. Hema Yoganarasimhan, 2020. "Search Personalization Using Machine Learning," Management Science, INFORMS, vol. 66(3), pages 1045-1070, March.
    20. Kathryn Bonney & Cory Breaux & Catherine Buffington & Emin Dinlersoz & Lucia Foster & Nathan Goldschlag & John Haltiwanger & Zachary Kroff & Keith Savage, 2024. "Tracking Firm Use of AI in Real Time: A Snapshot from the Business Trends and Outlook Survey," Working Papers 24-16, Center for Economic Studies, U.S. Census Bureau.
    21. Anders Humlum & Emilie Vestergaard, 2025. "Large Language Models, Small Labor Market Effects," NBER Working Papers 33777, National Bureau of Economic Research, Inc.
    22. Joonhyuk Yang & Navdeep S. Sahni & Harikesh S. Nair & Xi Xiong, 2024. "Advertising as Information for Ranking E-Commerce Search Listings," Marketing Science, INFORMS, vol. 43(2), pages 360-377, March.
    23. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    24. Gu, Chris & Wang, Yike, 2022. "Consumer online search with partially revealed information," LSE Research Online Documents on Economics 109871, London School of Economics and Political Science, LSE Library.
    25. Belleflamme,Paul & Peitz,Martin, 2021. "The Economics of Platforms," Cambridge Books, Cambridge University Press, number 9781108710749, January.
    26. Thomas Blake & Chris Nosko & Steven Tadelis, 2015. "Consumer Heterogeneity and Paid Search Effectiveness: A Large‐Scale Field Experiment," Econometrica, Econometric Society, vol. 83, pages 155-174, January.
    27. Anindya Ghose & Panagiotis G. Ipeirotis & Beibei Li, 2019. "Modeling Consumer Footprints on Search Engines: An Interplay with Social Media," Management Science, INFORMS, vol. 65(3), pages 1363-1385, March.
    28. Avi Goldfarb & Catherine Tucker, 2011. "Rejoinder--Implications of "Online Display Advertising: Targeting and Obtrusiveness"," Marketing Science, INFORMS, vol. 30(3), pages 413-415, 05-06.
    29. Li, Yinan & Liu, Ying & Yu, Muran, 2025. "Consumer segmentation with large language models," Journal of Retailing and Consumer Services, Elsevier, vol. 82(C).
    30. Chris Gu & Yike Wang, 2022. "Consumer Online Search with Partially Revealed Information," Management Science, INFORMS, vol. 68(6), pages 4215-4235, June.
    31. Luís Cabral & Ali Hortaçsu, 2010. "The Dynamics Of Seller Reputation: Evidence From Ebay," Journal of Industrial Economics, Wiley Blackwell, vol. 58(1), pages 54-78, March.
    32. Fan, Ying & Ju, Jiandong & Xiao, Mo, 2016. "Reputation premium and reputation management: Evidence from the largest e-commerce platform in China," International Journal of Industrial Organization, Elsevier, vol. 46(C), pages 63-76.
    33. Huanxing Yang, 2013. "Targeted search and the long tail effect," RAND Journal of Economics, RAND Corporation, vol. 44(4), pages 733-756, December.
    34. Bingchen Liu & Yuanyuan Fang & Naixing Xu & Shihao Hou & Xin Li & Qian Li, 2025. "Large Language Models for Knowledge Graph Embedding: A Survey," Mathematics, MDPI, vol. 13(14), pages 1-28, July.
    35. Zenan Chen & Jason Chan, 2024. "Large Language Model in Creative Work: The Role of Collaboration Modality and User Expertise," Management Science, INFORMS, vol. 70(12), pages 9101-9117, December.
    36. Dirk Bergemann & Alessandro Bonatti, 2011. "Targeting in advertising markets: implications for offline versus online media," RAND Journal of Economics, RAND Corporation, vol. 42(3), pages 417-443, September.
    37. Jiafeng Chen & Jonathan Roth, 2024. "Logs with Zeros? Some Problems and Solutions," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 139(2), pages 891-936.
    38. Flavio Calvino & Jelmer Reijerink & Lea Samek, 2025. "The effects of generative AI on productivity, innovation and entrepreneurship," OECD Artificial Intelligence Papers 39, OECD Publishing.
    39. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue nov.
    40. Jens-Uwe Franck & Martin Peitz, 2021. "Market Definition in the Platform Economy," CRC TR 224 Discussion Paper Series crctr224_2021_259v2, University of Bonn and University of Mannheim, Germany.
    41. Wei Zhou & Mingfeng Lin & Mo Xiao & Lu Fang, 2025. "Higher Precision Is Not Always Better: Search Algorithm and Consumer Engagement," Management Science, INFORMS, vol. 71(7), pages 6204-6226, July.
    42. Chris Nosko & Steven Tadelis, 2015. "The Limits of Reputation in Platform Markets: An Empirical Analysis and Field Experiment," NBER Working Papers 20830, National Bureau of Economic Research, Inc.
    43. Steven Tadelis, 2016. "Reputation and Feedback Systems in Online Platform Markets," Annual Review of Economics, Annual Reviews, vol. 8(1), pages 321-340, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lu Fang & Zhe Yuan & Kaifu Zhang & Dante Donati & Miklos Sarvary, 2025. "Generative AI and Firm Productivity: Field Experiments in Online Retail," CESifo Working Paper Series 12201, CESifo.
    2. Wei Zhou & Zidong Wang, 2020. "Competing for Search Traffic in Query Markets: Entry Strategy, Platform Design, and Entrepreneurship," Working Papers 20-12, NET Institute.
    3. Paul Belleflamme & Martin Peitz, 2018. "Inside the Engine Room of Digital Platforms: Reviews, Ratings, and Recommendations," Working Papers halshs-01714549, HAL.
    4. Gesche, Tobias, 2018. "Reference Price Shifts and Customer Antagonism: Evidence from Reviews for Online Auctions," VfS Annual Conference 2018 (Freiburg, Breisgau): Digital Economy 181650, Verein für Socialpolitik / German Economic Association.
    5. Xiang Hui & Meng Liu & Raphael Thomadsen, 2022. "Quality Certificates Alleviate Consumer Aversion to Sponsored Search Advertising," CESifo Working Paper Series 9886, CESifo.
    6. Van Reenen, John, 2011. "Does competition raise productivity through improving management quality?," International Journal of Industrial Organization, Elsevier, vol. 29(3), pages 306-316, May.
    7. Yassine Lefouili & Leonardo Madio, 2022. "The economics of platform liability," European Journal of Law and Economics, Springer, vol. 53(3), pages 319-351, June.
    8. Steffen, Nico & Wiewiorra, Lukas & Kroon, Peter, 2021. "Wettbewerb und Regulierung in der Plattform- und Datenökonomie," WIK Discussion Papers 481, WIK Wissenschaftliches Institut für Infrastruktur und Kommunikationsdienste GmbH.
    9. Hui, Xiang & Klein, Tobias & Stahl, Konrad, 2022. "Learning from Online Ratings," CEPR Discussion Papers 17006, C.E.P.R. Discussion Papers.
    10. Barth, Erling & Davis, James C. & Freeman, Richard B. & McElheran, Kristina, 2023. "Twisting the demand curve: Digitalization and the older workforce," Journal of Econometrics, Elsevier, vol. 233(2), pages 443-467.
    11. Riccardo Zanardelli, 2025. "The human-machine paradox: how collaboration creates or destroys value, and why augmentation is key to resolving it," Papers 2509.14057, arXiv.org, revised Nov 2025.
    12. Alessandro De Chiara & Juan José Ganuza & Fernando Gómez & Ester Manna & Adrián Segura, 2023. "Platform liability with reputational sanctions," Economics Working Papers 1868, Department of Economics and Business, Universitat Pompeu Fabra.
    13. Lingfang (Ivy) Li & Steven Tadelis & Xiaolan Zhou, 2020. "Buying reputation as a signal of quality: Evidence from an online marketplace," RAND Journal of Economics, RAND Corporation, vol. 51(4), pages 965-988, December.
    14. Zhang, Weiyi & Wang, Yong, 2025. "The impact of different recommendation algorithms on consumer search behavior and merchants competition," International Review of Economics & Finance, Elsevier, vol. 98(C).
    15. Irene Brambilla, 2018. "Digital Technology Adoption and Jobs: A Model of Firm Heterogeneity," Department of Economics, Working Papers 117, Departamento de Economía, Facultad de Ciencias Económicas, Universidad Nacional de La Plata.
    16. Kiran Tomlinson & Sonia Jaffe & Will Wang & Scott Counts & Siddharth Suri, 2025. "Working with AI: Measuring the Applicability of Generative AI to Occupations," Papers 2507.07935, arXiv.org, revised Oct 2025.
    17. Apostolos Filippas & John J. Horton & Richard J. Zeckhauser, 2020. "Owning, Using, and Renting: Some Simple Economics of the “Sharing Economy”," Management Science, INFORMS, vol. 66(9), pages 4152-4172, September.
    18. Rüdiger Bachmann & Gabriel Ehrlich & Ying Fan & Dimitrije Ruzic & Benjamin Leard, 2023. "Firms and Collective Reputation: a Study of the Volkswagen Emissions Scandal," Journal of the European Economic Association, European Economic Association, vol. 21(2), pages 484-525.
    19. Braesemann, Fabian & Stephany, Fabian & Teutloff, Ole & Kässi, Otto & Graham, Mark & Lehdonvirta, Vili, 2021. "The polarisation of remote work," SocArXiv q8a96, Center for Open Science.
    20. Andreas J. Steur & Mischa Seiter, 2021. "Properties of feedback mechanisms on digital platforms: an exploratory study," Journal of Business Economics, Springer, vol. 91(4), pages 479-526, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2510.12049. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.