IDEAS home Printed from https://ideas.repec.org/p/bis/biswps/1208.html
   My bibliography  Save this paper

Generative AI and labour productivity: a field experiment on coding

Author

Listed:
  • Leonardo Gambacorta
  • Han Qiu
  • Shuo Shan
  • Daniel M Rees

Abstract

In this paper we examine the effects of generative artificial intelligence (gen AI) on labour productivity. In September 2023, Ant Group introduced CodeFuse, a large language model (LLM) designed to assist programmer teams with coding. While one group of programmers used it, other programmer teams were not informed about this LLM. Leveraging this event, we conducted a field experiment on these two groups of programmers. We identified employees who used CodeFuse as the treatment group and paired them with comparable employees in the control group, to assess the impact of AI on their productivity. Our findings indicate that the use of gen AI increased code output by more than 50%. However, productivity gains are statistically significant only among entry-level or junior staff, while the impact on more senior employees is less pronounced.

Suggested Citation

  • Leonardo Gambacorta & Han Qiu & Shuo Shan & Daniel M Rees, 2024. "Generative AI and labour productivity: a field experiment on coding," BIS Working Papers 1208, Bank for International Settlements.
    • Handle: RePEc:bis:biswps:1208
    as

    Download full text from publisher

    File URL: https://www.bis.org/publ/work1208.pdf
    File Function: Full PDF document
    Download Restriction: no
    File URL: https://www.bis.org/publ/work1208.htm
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Danielle Li & Lindsey Raymond, 2025. "Generative AI at Work," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 140(2), pages 889-942.
    2. Zied Bahroun & Chiraz Anane & Vian Ahmed & Andrew Zacca, 2023. "Transforming Education: A Comprehensive Review of Generative Artificial Intelligence in Educational Settings through Bibliometric and Content Analysis," Sustainability, MDPI, vol. 15(17), pages 1-40, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Douglas Araujo & Rafael Schmidt & Olivier Sirello & Bruno Tissot & Ricardo Villarreal, 2025. "Governance and implementation of artificial intelligence in central banks," IFC Reports 18, Bank for International Settlements.
    2. Herbert Dawid & Philipp Harting & Hankui Wang & Zhongli Wang & Jiachen Yi, 2025. "Agentic Workflows for Economic Research: Design and Implementation," Papers 2504.09736, arXiv.org.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zara Contractor & Germ'an Reyes, 2025. "Generative AI in Higher Education: Evidence from an Elite College," Papers 2508.00717, arXiv.org.
    2. Christoph Riedl & Eric Bogert, 2024. "Effects of AI Feedback on Learning, the Skill Gap, and Intellectual Diversity," Papers 2409.18660, arXiv.org.
    3. Carvajal, Daniel & Franco, Catalina & Isaksson, Siri, 2024. "Will Artificial Intelligence Get in the Way of Achieving Gender Equality?," Discussion Paper Series in Economics 3/2024, Norwegian School of Economics, Department of Economics, revised 28 Apr 2025.
    4. Gaétan de Rassenfosse & Adam B. Jaffe & Joel Waldfogel, 2025. "Intellectual Property and Creative Machines," Entrepreneurship and Innovation Policy and the Economy, University of Chicago Press, vol. 4(1), pages 47-79.
    5. Lilia Patrignani, 2024. "Understanding digital trade," Questioni di Economia e Finanza (Occasional Papers) 841, Bank of Italy, Economic Research and International Relations Area.
    6. Amali Matharaarachchi & Wishmitha Mendis & Kanishka Randunu & Daswin De Silva & Gihan Gamage & Harsha Moraliyage & Nishan Mills & Andrew Jennings, 2024. "Optimizing Generative AI Chatbots for Net-Zero Emissions Energy Internet-of-Things Infrastructure," Energies, MDPI, vol. 17(8), pages 1-19, April.
    7. Andreas D. Landmark & Johan E. Ravn & Hans Y. Torvatn & Lisbeth Øyum, 2024. "Digital Transformations Through the Lens of the Collaborative, Co-Generative and Domesticative," Systemic Practice and Action Research, Springer, vol. 37(5), pages 537-548, October.
    8. Martin Baily & David Byrne & Aidan Kane & Paul Soto, 2025. "Generative AI at the Crossroads: Light Bulb, Dynamo, or Microscope?," Papers 2505.14588, arXiv.org, revised Sep 2025.
    9. Christian Peukert & Florian Abeillon & Jérémie Haese & Franziska Kaiser & Alexander Staub, 2024. "Strategic Behavior and AI Training Data," CESifo Working Paper Series 11099, CESifo.
    10. Nida Çakır Melek, 2025. "Marshall B. Reinsdorf and Louise Sheiner (editors): The Measure of Economies: Measuring Productivity in an Age of Technological Change," Business Economics, Palgrave Macmillan;National Association for Business Economics, vol. 60(3), pages 175-178, July.
    11. Antonia Meythaler & Annika Baumann & Hanna Krasnova & Oliver Hinz & Sarah Spiekermann, 2023. "Technology for Humanity," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 65(5), pages 487-496, October.
    12. Sharique Hasan & Alexander Oettl & Sampsa Samila, 2025. "From Model Design to Organizational Design: Complexity Redistribution and Trade-Offs in Generative AI," Papers 2506.22440, arXiv.org.
    13. Contractor, Zara & Reyes, Germán, 2025. "Generative AI in Higher Education: Evidence from an Elite College," IZA Discussion Papers 18055, Institute of Labor Economics (IZA).
    14. repec:vrs:irfinc:v:9:y:2024:i:2:p:1-18:n:1001 is not listed on IDEAS
    15. Stankov, Petar, 2024. "The death of exams? Grade inflation and student satisfaction when coursework replaces exams," International Review of Economics Education, Elsevier, vol. 46(C).
    16. Iñaki Aldasoro & Leonardo Gambacorta & Anton Korinek & Vatsala Shreeti & Merlin Stein, 2024. "Intelligent financial system: how AI is transforming finance," BIS Working Papers 1194, Bank for International Settlements.
    17. Fransoo, Jan C. & Peels, Robert & Udenio, Maximiliano, 2025. "Navigating supply chain dynamics for sustained AI growth," Other publications TiSEM 771fa325-5fbb-4b03-b6bd-b, Tilburg University, School of Economics and Management.
    18. Nickel, Christiane & Kilponen, Juha & Moral-Benito, Enrique & Koester, Gerrit & Ciccarelli, Matteo & Enders, Almira & Holton, Sarah & Landau, Bettina & Venditti, Fabrizio & Bobeica, Elena & Brand, Cla, 2025. "A strategic view on the economic and inflation environment in the euro area," Occasional Paper Series 371, European Central Bank.
    19. William G. Resh & Yi Ming & Xinyao Xia & Michael Overton & Gul Nisa Gurbuz & Brandon De Bruhl, 2025. "Complementarity, Augmentation, or Substitutivity? The Impact of Generative Artificial Intelligence on the U.S. Federal Workforce," Papers 2503.09637, arXiv.org.
    20. Udayan Mukherjee & Harry Nicholls, 2024. "The impact of artificial intelligence – an economic analysis," Treasury Analytical Notes Series an24/06, New Zealand Treasury.
    21. Spencer Bastani & Daniel Waldenström, 2024. "AI, automation and taxation," Chapters, in: Stéphane Carcillo & Stefano Scarpetta (ed.), Handbook on Labour Markets in Transition, chapter 19, pages 354-370, Edward Elgar Publishing.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    JEL classification:

    • D22 - Microeconomics - - Production and Organizations - - - Firm Behavior: Empirical Analysis
    • G31 - Financial Economics - - Corporate Finance and Governance - - - Capital Budgeting; Fixed Investment and Inventory Studies
    • R30 - Urban, Rural, Regional, Real Estate, and Transportation Economics - - Real Estate Markets, Spatial Production Analysis, and Firm Location - - - General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bis:biswps:1208. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Martin Fessler (email available below). General contact details of provider: https://edirc.repec.org/data/bisssch.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.