IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2303.10130.html
   My bibliography  Save this paper

GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models

Author

Listed:
  • Tyna Eloundou
  • Sam Manning
  • Pamela Mishkin
  • Daniel Rock

Abstract

We investigate the potential implications of large language models (LLMs), such as Generative Pre-trained Transformers (GPTs), on the U.S. labor market, focusing on the increased capabilities arising from LLM-powered software compared to LLMs on their own. Using a new rubric, we assess occupations based on their alignment with LLM capabilities, integrating both human expertise and GPT-4 classifications. Our findings reveal that around 80% of the U.S. workforce could have at least 10% of their work tasks affected by the introduction of LLMs, while approximately 19% of workers may see at least 50% of their tasks impacted. We do not make predictions about the development or adoption timeline of such LLMs. The projected effects span all wage levels, with higher-income jobs potentially facing greater exposure to LLM capabilities and LLM-powered software. Significantly, these impacts are not restricted to industries with higher recent productivity growth. Our analysis suggests that, with access to an LLM, about 15% of all worker tasks in the US could be completed significantly faster at the same level of quality. When incorporating software and tooling built on top of LLMs, this share increases to between 47 and 56% of all tasks. This finding implies that LLM-powered software will have a substantial effect on scaling the economic impacts of the underlying models. We conclude that LLMs such as GPTs exhibit traits of general-purpose technologies, indicating that they could have considerable economic, social, and policy implications.

Suggested Citation

  • Tyna Eloundou & Sam Manning & Pamela Mishkin & Daniel Rock, 2023. "GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models," Papers 2303.10130, arXiv.org, revised Aug 2023.
  • Handle: RePEc:arx:papers:2303.10130
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2303.10130
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2021. "The Productivity J-Curve: How Intangibles Complement General Purpose Technologies," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(1), pages 333-372, January.
    2. Daron Acemoglu & Pascual Restrepo, 2019. "Automation and New Tasks: How Technology Displaces and Reinstates Labor," Journal of Economic Perspectives, American Economic Association, vol. 33(2), pages 3-30, Spring.
    3. Goldfarb, Avi & Taska, Bledi & Teodoridis, Florenta, 2023. "Could machine learning be a general purpose technology? A comparison of emerging technologies using data from online job postings," Research Policy, Elsevier, vol. 52(1).
    4. Benjamin Meindl & Morgan R. Frank & Joana Mendonc{c}a, 2021. "Exposure of occupations to technologies of the fourth industrial revolution," Papers 2110.13317, arXiv.org.
    5. Seth G. Benzell & Laurence J. Kotlikoff & Guillermo LaGarda & Victor Yifan Ye, 2021. "Simulating Endogenous Global Automation," NBER Working Papers 29220, National Bureau of Economic Research, Inc.
    6. Benjamin Moll & Lukasz Rachel & Pascual Restrepo, 2022. "Uneven Growth: Automation's Impact on Income and Wealth Inequality," Econometrica, Econometric Society, vol. 90(6), pages 2645-2683, November.
    7. Daron Acemoglu & David Autor & Jonathon Hazell & Pascual Restrepo, 2020. "AI and Jobs: Evidence from Online Vacancies," NBER Working Papers 28257, National Bureau of Economic Research, Inc.
    8. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The skill content of recent technological change: an empirical exploration," Proceedings, Federal Reserve Bank of San Francisco, issue Nov.
    9. David Autor & Caroline Chin & Anna Salomons & Bryan Seegmiller, 2022. "New frontiers: The origins and content of new work, 1940-2018," POID Working Papers 049, Centre for Economic Performance, LSE.
    10. Timothy Bresnahan & Shane Greenstein, 1996. "Technical Progress and Co-invention in Computing and in the Uses of Computers," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 27(1996 Micr), pages 1-83.
    11. Leonid Kogan & Dimitris Papanikolaou & Lawrence D. W. Schmidt & Bryan Seegmiller, 2021. "Technology, Vintage-Specific Human Capital, and Labor Displacement: Evidence from Linking Patents with Occupations," NBER Working Papers 29552, National Bureau of Economic Research, Inc.
    12. Daron Acemoglu & Pascual Restrepo, 2018. "The Race between Man and Machine: Implications of Technology for Growth, Factor Shares, and Employment," American Economic Review, American Economic Association, vol. 108(6), pages 1488-1542, June.
    13. Korinek, Anton, 2023. "Language Models and Cognitive Automation for Economic Research," CEPR Discussion Papers 17923, C.E.P.R. Discussion Papers.
    14. Van Reenen, John, 2011. "Wage inequality, technology and trade: 21st century evidence," Labour Economics, Elsevier, vol. 18(6), pages 730-741.
    15. Daron Acemoglu & Pascual Restrepo, 2022. "Demographics and Automation [Automation and Demographic Change]," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 89(1), pages 1-44.
    16. Timothy F. Bresnahan & Erik Brynjolfsson & Lorin M. Hitt, 2002. "Information Technology, Workplace Organization, and the Demand for Skilled Labor: Firm-Level Evidence," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 117(1), pages 339-376.
    17. Daron Acemoglu & Pascual Restrepo, 2022. "Tasks, Automation, and the Rise in U.S. Wage Inequality," Econometrica, Econometric Society, vol. 90(5), pages 1973-2016, September.
    18. Katya Klinova & Anton Korinek, 2021. "AI and Shared Prosperity," Papers 2105.08475, arXiv.org.
    19. Lipsey, Richard G. & Carlaw, Kenneth I. & Bekar, Clifford T., 2005. "Economic Transformations: General Purpose Technologies and Long-Term Economic Growth," OUP Catalogue, Oxford University Press, number 9780199290895.
    20. Erik Brynjolfsson & Tom Mitchell & Daniel Rock, 2018. "What Can Machines Learn, and What Does It Mean for Occupations and the Economy?," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 43-47, May.
    21. Frey, Carl Benedikt & Osborne, Michael A., 2017. "The future of employment: How susceptible are jobs to computerisation?," Technological Forecasting and Social Change, Elsevier, vol. 114(C), pages 254-280.
    22. Ajay K. Agrawal & Joshua S. Gans & Avi Goldfarb, 2021. "AI Adoption and System-Wide Change," NBER Working Papers 28811, National Bureau of Economic Research, Inc.
    23. Bresnahan, Timothy F, 1999. "Computerisation and Wage Dispersion: An Analytical Reinterpretation," Economic Journal, Royal Economic Society, vol. 109(456), pages 390-415, June.
    24. Arntz, Melanie & Gregory, Terry & Zierahn, Ulrich, 2017. "Revisiting the risk of automation," Economics Letters, Elsevier, vol. 159(C), pages 157-160.
    25. Edward W. Felten & Manav Raj & Robert Seamans, 2018. "A Method to Link Advances in Artificial Intelligence to Occupational Abilities," AEA Papers and Proceedings, American Economic Association, vol. 108, pages 54-57, May.
    26. Ed Felten & Manav Raj & Robert Seamans, 2023. "How will Language Modelers like ChatGPT Affect Occupations and Industries?," Papers 2303.01157, arXiv.org, revised Mar 2023.
    27. Daron Acemoglu, 2002. "Technical Change, Inequality, and the Labor Market," Journal of Economic Literature, American Economic Association, vol. 40(1), pages 7-72, March.
    28. John J. Horton, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," Papers 2301.07543, arXiv.org.
    29. Iain M. Cockburn & Rebecca Henderson & Scott Stern, 2018. "The Impact of Artificial Intelligence on Innovation," NBER Working Papers 24449, National Bureau of Economic Research, Inc.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jasmine Mondolo, 2022. "The composite link between technological change and employment: A survey of the literature," Journal of Economic Surveys, Wiley Blackwell, vol. 36(4), pages 1027-1068, September.
    2. Qin Chen & Jinfeng Ge & Huaqing Xie & Xingcheng Xu & Yanqing Yang, 2023. "Large Language Models at Work in China's Labor Market," Papers 2308.08776, arXiv.org.
    3. Fossen, Frank M. & Sorgner, Alina, 2022. "New digital technologies and heterogeneous wage and employment dynamics in the United States: Evidence from individual-level data," Technological Forecasting and Social Change, Elsevier, vol. 175(C).
    4. Genz, Sabrina & Schnabel, Claus, 2021. "Digging into the digital divide: Workers' exposure to digitalization and its consequences for individual employment," Discussion Papers 118, Friedrich-Alexander University Erlangen-Nuremberg, Chair of Labour and Regional Economics.
    5. Fabio Montobbio & Jacopo Staccioli & Maria Enrica Virgillito & Marco Vivarelli, 2021. "Labour-saving automation and occupational exposure: a text-similarity measure," DISCE - Quaderni del Dipartimento di Politica Economica dipe0021, Università Cattolica del Sacro Cuore, Dipartimenti e Istituti di Scienze Economiche (DISCE).
    6. Czarnitzki, Dirk & Fernández, Gastón P. & Rammer, Christian, 2023. "Artificial intelligence and firm-level productivity," Journal of Economic Behavior & Organization, Elsevier, vol. 211(C), pages 188-205.
    7. Songul Tolan & Annarosa Pesole & Fernando Martinez-Plumed & Enrique Fernandez-Macias & José Hernandez-Orallo & Emilia Gomez, 2020. "Measuring the Occupational Impact of AI: Tasks, Cognitive Abilities and AI Benchmarks," JRC Working Papers on Labour, Education and Technology 2020-02, Joint Research Centre.
    8. Roberto Antonietti & Luca Cattani & Francesca Gambarotto & Giulio Pedrini, 2021. "Education, routine, and complexity-biased Knowledge Enabling Technologies: Evidence from Emilia-Romagna, Italy," Discussion Paper series in Regional Science & Economic Geography 2021-07, Gran Sasso Science Institute, Social Sciences, revised May 2021.
    9. Innocenti, Stefania & Golin, Marta, 2022. "Human capital investment and perceived automation risks: Evidence from 16 countries," Journal of Economic Behavior & Organization, Elsevier, vol. 195(C), pages 27-41.
    10. Caselli, Mauro & Fracasso, Andrea & Scicchitano, Sergio & Traverso, Silvio & Tundis, Enrico, 2021. "Stop worrying and love the robot: An activity-based approach to assess the impact of robotization on employment dynamics," GLO Discussion Paper Series 802, Global Labor Organization (GLO).
    11. Caselli, Mauro & Fracasso, Andrea & Marcolin, Arianna & Scicchitano, Sergio, 2021. "The reassuring effect of firms' technological innovations on workers' job insecurity," GLO Discussion Paper Series 938, Global Labor Organization (GLO).
    12. Barth, Erling & Davis, James C. & Freeman, Richard B. & McElheran, Kristina, 2023. "Twisting the demand curve: Digitalization and the older workforce," Journal of Econometrics, Elsevier, vol. 233(2), pages 443-467.
    13. Montobbio, Fabio & Staccioli, Jacopo & Virgillito, Maria Enrica & Vivarelli, Marco, 2022. "Robots and the origin of their labour-saving impact," Technological Forecasting and Social Change, Elsevier, vol. 174(C).
    14. Gries, Thomas & Naudé, Wim, 2022. "Modelling artificial intelligence in economics," Journal for Labour Market Research, Institut für Arbeitsmarkt- und Berufsforschung (IAB), Nürnberg [Institute for Employment Research, Nuremberg, Germany], vol. 56, pages 1-12.
    15. Genz, Sabrina & Gregory, Terry & Janser, Markus & Lehmer, Florian & Matthes, Britta, 2021. "How do workers adjust when firms adopt new technologies?," ZEW Discussion Papers 21-073, ZEW - Leibniz Centre for European Economic Research.
    16. David Autor & Caroline Chin & Anna M. Salomons & Bryan Seegmiller, 2022. "New Frontiers: The Origins and Content of New Work, 1940–2018," NBER Working Papers 30389, National Bureau of Economic Research, Inc.
    17. Arntz, Melanie & Gregory, Terry & Zierahn, Ulrich, 2019. "Digitalization and the Future of Work: Macroeconomic Consequences," IZA Discussion Papers 12428, Institute of Labor Economics (IZA).
    18. Fossen, Frank M. & Sorgner, Alina, 2019. "New Digital Technologies and Heterogeneous Employment and Wage Dynamics in the United States: Evidence from Individual-Level Data," IZA Discussion Papers 12242, Institute of Labor Economics (IZA).
    19. Kostøl, Fredrik B. & Svarstad, Elin, 2023. "Trade Unions and the Process of Technological Change," Labour Economics, Elsevier, vol. 84(C).
    20. Ekaterina Prytkova & Fabien Petit & Deyu Li & Sugat Chaturvedi & Tommaso Ciarli, 2024. "The Employment Impact of Emerging Digital Technologies," CEPEO Working Paper Series 24-01, UCL Centre for Education Policy and Equalising Opportunities, revised Feb 2024.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2303.10130. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.