IDEAS home Printed from https://ideas.repec.org/p/fip/fedgfe/2025-11.html

Research in Commotion: Measuring AI Research and Development through Conference Call Transcripts

Author

Abstract

This paper introduces a novel measure of firm-level Artificial Intelligence (AI) Research & Development—the AIR Index—derived from the semantic similarity between earnings conference call transcripts and leading AI research papers. The AIR Index varies widely across industries, with sustained strength in computer and electronic manufacturing, and accelerating growth in computing infrastructure and educational services seen after the introduction of ChatGPT in November 2022. I find that the AIR Index is associated with an immediate increase in Tobin’s Q and can help explain the cross-section of cumulative absolute returns following the conference call, suggestive of investors valuing substantive AI discussions in the near-term. A sharp rise in the AIR Index leads to persistent increases in year-over-year capex growth, lasting about a year before tapering off, indicative of the life cycle of AI-induced capital deepening. However, I find no significant effects of AI R&D on productivity or employment. Using industry level survey data from Census, I find that recent growth in the AIR Index correlates with broader AI adoption trends. The positive association of the AIR Index with capex and valuation holds across previous time periods, suggesting that Generative AI may be the latest form of an ongoing technical innovation process, albeit at an accelerated pace.

Suggested Citation

  • Paul E. Soto, 2025. "Research in Commotion: Measuring AI Research and Development through Conference Call Transcripts," Finance and Economics Discussion Series 2025-011, Board of Governors of the Federal Reserve System (U.S.).
    • Handle: RePEc:fip:fedgfe:2025-11
    DOI: 10.17016/FEDS.2025.011
    as

    Download full text from publisher

    File URL: https://www.federalreserve.gov/econres/feds/files/2025011pap.pdf
    Download Restriction: no
    File URL: https://libkey.io/10.17016/FEDS.2025.011?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Erik Brynjolfsson & Daniel Rock & Chad Syverson, 2021. "The Productivity J-Curve: How Intangibles Complement General Purpose Technologies," American Economic Journal: Macroeconomics, American Economic Association, vol. 13(1), pages 333-372, January.
    2. Carol Corrado & Charles Hulten & Daniel Sichel, 2005. "Measuring Capital and Technology: An Expanded Framework," NBER Chapters, in: Measuring Capital in the New Economy, pages 11-46, National Bureau of Economic Research, Inc.
    3. David M. Byrne & John G. Fernald & Marshall B. Reinsdorf, 2016. "Does the United States Have a Productivity Slowdown or a Measurement Problem?," Brookings Papers on Economic Activity, Economic Studies Program, The Brookings Institution, vol. 47(1 (Spring), pages 109-182.
    4. Daron Acemoglu & Pascual Restrepo, 2018. "Artificial Intelligence, Automation and Work," Boston University - Department of Economics - Working Papers Series dp-298, Boston University - Department of Economics.
    5. Kewei Hou & Chen Xue & Lu Zhang, 2015. "Editor's Choice Digesting Anomalies: An Investment Approach," The Review of Financial Studies, Society for Financial Studies, vol. 28(3), pages 650-705.
    6. Fama, Eugene F. & French, Kenneth R., 2015. "A five-factor asset pricing model," Journal of Financial Economics, Elsevier, vol. 116(1), pages 1-22.
    7. Kevin J. Stiroh, 2002. "Information Technology and the U.S. Productivity Revival: What Do the Industry Data Say?," American Economic Review, American Economic Association, vol. 92(5), pages 1559-1576, December.
    8. Elliott Ash & Stephen Hansen, 2023. "Text Algorithms in Economics," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 659-688, September.
    9. Steven J. Davis & Stephen Hansen & Cristhian Seminario-Amez, 2020. "Firm-Level Risk Exposures and Stock Returns in the Wake of Covid-19," CESifo Working Paper Series 8594, CESifo.
    10. David H. Autor & Frank Levy & Richard J. Murnane, 2003. "The Skill Content of Recent Technological Change: An Empirical Exploration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 118(4), pages 1279-1333.
    11. Michael J. Cooper & Orlin Dimitrov & P. Raghavendra Rau, 2001. "A Rose.com by Any Other Name," Journal of Finance, American Finance Association, vol. 56(6), pages 2371-2388, December.
    12. Babina, Tania & Fedyk, Anastassia & He, Alex & Hodson, James, 2024. "Artificial intelligence, firm growth, and product innovation," Journal of Financial Economics, Elsevier, vol. 151(C).
    13. Jushan Bai & Pierre Perron, 1998. "Estimating and Testing Linear Models with Multiple Structural Changes," Econometrica, Econometric Society, vol. 66(1), pages 47-78, January.
    14. Tyna Eloundou & Sam Manning & Pamela Mishkin & Daniel Rock, 2023. "GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Models," Papers 2303.10130, arXiv.org, revised Aug 2023.
    15. Hayashi, Fumio, 1982. "Tobin's Marginal q and Average q: A Neoclassical Interpretation," Econometrica, Econometric Society, vol. 50(1), pages 213-224, January.
    16. Dario Caldara & Matteo Iacoviello, 2022. "Measuring Geopolitical Risk," American Economic Review, American Economic Association, vol. 112(4), pages 1194-1225, April.
    17. Paul E. Soto, 2021. "Breaking the Word Bank: Measurement and Effects of Bank Level Uncertainty," Journal of Financial Services Research, Springer;Western Finance Association, vol. 59(1), pages 1-45, April.
    18. Humlum, Anders & Vestergaard, Emilie, 2024. "The Adoption of ChatGPT," IZA Discussion Papers 16992, IZA Network @ LISER.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Leland D. Crane & Paul E. Soto, 2026. "AI and Coder Employment: Compiling the Evidence," Finance and Economics Discussion Series 2026-018, Board of Governors of the Federal Reserve System (U.S.).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wu, Yifan & Yuan, Yiming & Song, Xueyin, 2025. "The impact of AI adoption on R&D productivity: Evidence from Chinese pharmaceutical manufacturing industry," Journal of Asian Economics, Elsevier, vol. 97(C).
    2. Christoph Riedl & Eric Bogert, 2024. "Who Benefits from AI? Self-Selection, Skill Gap, and the Hidden Costs of AI Feedback," Papers 2409.18660, arXiv.org, revised Apr 2026.
    3. Cao, Sean & Jiang, Wei & Wang, Junbo & Yang, Baozhong, 2024. "From Man vs. Machine to Man + Machine: The art and AI of stock analyses," Journal of Financial Economics, Elsevier, vol. 160(C).
    4. Cujean, Julien & Andrei, Daniel & Fournier, Mathieu, 2019. "The Low-Minus-High Portfolio and the Factor Zoo," CEPR Discussion Papers 14153, Centre for Economic Policy Research.
    5. repec:rim:rimwps:17-30 is not listed on IDEAS
    6. Dou, Bin & Guo, SongLin & Chang, XiaoChen & Wang, Yong, 2023. "Corporate digital transformation and labor structure upgrading," International Review of Financial Analysis, Elsevier, vol. 90(C).
    7. Lei Xia & Qingjiang Han & Shui Yu, 2024. "RETRACTED ARTICLE: Sustainable manufacturing intelligence: pathways for high-quality and energy efficient economic growth," Economic Change and Restructuring, Springer, vol. 57(3), pages 1-30, June.
    8. Luca Grilli & Sergio Mariotti & Riccardo Marzano, 2024. "Artificial intelligence and shapeshifting capitalism," Journal of Evolutionary Economics, Springer, vol. 34(2), pages 303-318, April.
    9. Huynh, Nhan, 2023. "Unemployment beta and the cross-section of stock returns: Evidence from Australia," International Review of Financial Analysis, Elsevier, vol. 86(C).
    10. Demombynes, Gabriel & Langbein, Jorg Gero & Weber, Michael, 2025. "The Exposure of Workers to Artificial Intelligence in Low- and Middle-Income Countries," Policy Research Working Paper Series 11057, The World Bank.
    11. Flavio Calvino & Luca Fontanelli, 2025. "Decoding AI: Nine facts about how firms use artificial intelligence in France," LEM Papers Series 2025/13, Laboratory of Economics and Management (LEM), Sant'Anna School of Advanced Studies, Pisa, Italy.
    12. David H. Kreitmeir & Paul A. Raschky, 2023. "The Unintended Consequences of Censoring Digital Technology - Evidence from Italy's ChatGPT Ban," SoDa Laboratories Working Paper Series 2023-01, Monash University.
    13. Long, Huaigang & Chiah, Mardy & Zaremba, Adam & Umar, Zaghum, 2024. "Changes in shares outstanding and country stock returns around the world," Journal of International Financial Markets, Institutions and Money, Elsevier, vol. 90(C).
    14. Long, Huaigang & Zaremba, Adam & Zhou, Wenyu & Bouri, Elie, 2022. "Macroeconomics matter: Leading economic indicators and the cross-section of global stock returns," Journal of Financial Markets, Elsevier, vol. 61(C).
    15. Hiroki, Takashi & Iwatsubo, Kentaro & Watkins, Clinton, 2022. "Does firm-level productivity predict stock returns?," Pacific-Basin Finance Journal, Elsevier, vol. 72(C).
    16. Ruyu Chen & Natarajan Balasubramanian & Chris Forman, 2024. "How does worker mobility affect business adoption of a new technology? The case of machine learning," Strategic Management Journal, Wiley Blackwell, vol. 45(8), pages 1510-1538, August.
    17. Gallipoli, Giovanni & Makridis, Christos A., 2018. "Structural transformation and the rise of information technology," Journal of Monetary Economics, Elsevier, vol. 97(C), pages 91-110.
    18. Yan Liu & He Wang, 2024. "Who on Earth Is Using Generative AI ?," Policy Research Working Paper Series 10870, The World Bank.
    19. Fontanelli, Luca & Guerini, Mattia & Miniaci, Raffaele & Secchi, Angelo, 2025. "Predictive AI and productivity growth dynamics: Evidence from French firms," Journal of Economic Behavior & Organization, Elsevier, vol. 240(C).
    20. Flavio Calvino & Chiara Criscuolo & Luca Fontanelli & Lionel Nesta & Elena Verdolini, 2024. "The role of human capital for AI adoption: Evidence from French firms," CEP Discussion Papers dp2055, Centre for Economic Performance, LSE.
    21. Anderton, Robert & Jarvis, Valerie & Labhard, Vincent & Morgan, Julian & Petroulakis, Filippos & Vivian, Lara, 2020. "Virtually everywhere? Digitalisation and the euro area and EU economies," Occasional Paper Series 244, European Central Bank.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    JEL classification:

    • O32 - Economic Development, Innovation, Technological Change, and Growth - - Innovation; Research and Development; Technological Change; Intellectual Property Rights - - - Management of Technological Innovation and R&D
    • E22 - Macroeconomics and Monetary Economics - - Consumption, Saving, Production, Employment, and Investment - - - Investment; Capital; Intangible Capital; Capacity
    • C49 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods: Special Topics - - - Other

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:2025-11. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.