IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2606.13812.html

CFOs Meet LLMs

Author

Listed:
  • John R. Graham
  • Campbell R. Harvey
  • Manish Jha

Abstract

Business sentiment is a closely watched economic signal, but measuring it is slow and costly: surveys reach only a few hundred firms, arrive periodically, and take time to compile. We show that large language models hold the potential to address these shortcomings. We prompt an LLM to role-play as the CFO of a specific company at a specific date and focus on the economic-optimism question on the Duke-Federal Reserve CFO Survey over 2002-2025. We find that the LLM reproduces individual human responses: the predicted optimism score significantly forecasts the CFO's actual answer, surviving firm and year-quarter fixed effects and a control for the most recent prior response. Predictive accuracy increases with the amount of information supplied, as both respondent history and firm characteristics improve fit, and the relationship persists under quarterly aggregation. With appropriate conditioning, LLMs may be able to serve as credible digital twins of executives, offering scalable, high-frequency expectations data for financial research and policy.

Suggested Citation

  • John R. Graham & Campbell R. Harvey & Manish Jha, 2026. "CFOs Meet LLMs," Papers 2606.13812, arXiv.org.
    • Handle: RePEc:arx:papers:2606.13812
    as

    Download full text from publisher

    File URL: https://arxiv.org/pdf/2606.13812
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Whitney Newey & Kenneth West, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    2. Paul C. Tetlock & Maytal Saar‐Tsechansky & Sofus Macskassy, 2008. "More Than Words: Quantifying Language to Measure Firms' Fundamentals," Journal of Finance, American Finance Association, vol. 63(3), pages 1437-1467, June.
    3. Stephen Hansen & Michael McMahon, 2016. "Shocking Language: Understanding the Macroeconomic Effects of Central Bank Communication," NBER Chapters, in: NBER International Seminar on Macroeconomics 2015, National Bureau of Economic Research, Inc.
    4. Sydney C. Ludvigson, 2004. "Consumer Confidence and Consumer Spending," Journal of Economic Perspectives, American Economic Association, vol. 18(2), pages 29-50, Spring.
    5. Alejandro Lopez-Lira & Yuehua Tang & Mingyin Zhu, 2025. "The Memorization Problem: Can We Trust LLMs' Economic Forecasts?," Papers 2504.14765, arXiv.org, revised Dec 2025.
    6. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," NBER Working Papers 32381, National Bureau of Economic Research, Inc.
    7. Balke, Nathan S & Petersen, D'Ann, 2002. "How Well Does the Beige Book Reflect Economic Activity? Evaluating Qualitative Information Quantitatively," Journal of Money, Credit and Banking, Blackwell Publishing, vol. 34(1), pages 114-136, February.
    8. Nicola Gennaioli & Yueran Ma & Andrei Shleifer, 2016. "Expectations and Investment," NBER Macroeconomics Annual, University of Chicago Press, vol. 30(1), pages 379-431.
    9. Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," Papers 2404.11794, arXiv.org, revised Apr 2024.
    10. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," Review of Finance, European Finance Association, vol. 33(5), pages 2223-2273.
    11. Salomé Baslandze & Zach Edwards & John Graham & Ty McClure & Brent Meyer & Michael Sparks & Sonya Ravindranath Waddell & Daniel J. Weitz, 2026. "Artificial Intelligence, Productivity, and the Workforce: Evidence from Corporate Executives," FRB Atlanta Working Paper 2026-04, Federal Reserve Bank of Atlanta.
    12. John Graham, 2022. "Presidential Address: Corporate Finance and Reality," NBER Working Papers 29841, National Bureau of Economic Research, Inc.
    13. Cao, Sean & Jiang, Wei & Wang, Junbo & Yang, Baozhong, 2024. "From Man vs. Machine to Man + Machine: The art and AI of stock analyses," Journal of Financial Economics, Elsevier, vol. 160(C).
    14. Federico Siano, 2025. "The News in Earnings Announcement Disclosures: Capturing Word Context Using LLM Methods," Management Science, INFORMS, vol. 71(11), pages 9831-9855, November.
    15. Olivier Coibion & Yuriy Gorodnichenko, 2012. "What Can Survey Forecasts Tell Us about Information Rigidities?," Journal of Political Economy, University of Chicago Press, vol. 120(1), pages 116-159.
    16. Itzhak Ben-David & John R. Graham, 2013. "Managerial Miscalibration," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 128(4), pages 1547-1584.
    17. Christian L. Goulding & Campbell R. Harvey & Hrvoje Kurtović, 2026. "Disagreement of Disagreement," NBER Working Papers 35049, National Bureau of Economic Research, Inc.
    18. Anton Korinek, 2023. "Generative AI for Economic Research: Use Cases and Implications for Economists," Journal of Economic Literature, American Economic Association, vol. 61(4), pages 1281-1317, December.
    19. Ajim Uddin & Xinyuan Tao & Dantong Yu, 2024. "The Network Factor of Equity Pricing: A Signed Graph Laplacian Approach," Journal of Financial Econometrics, Oxford University Press, vol. 22(5), pages 1616-1655.
    20. Graham, John R. & Harvey, Campbell R., 2001. "The theory and practice of corporate finance: evidence from the field," Journal of Financial Economics, Elsevier, vol. 60(2-3), pages 187-243, May.
    21. John R. Graham, 2022. "Presidential Address: Corporate Finance and Reality," Journal of Finance, American Finance Association, vol. 77(4), pages 1975-2049, August.
    22. Tim Loughran & Bill Mcdonald, 2011. "When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10‐Ks," Journal of Finance, American Finance Association, vol. 66(1), pages 35-65, February.
    23. Ulrike Malmendier & Geoffrey Tate, 2015. "Behavioral CEOs: The Role of Managerial Overconfidence," Journal of Economic Perspectives, American Economic Association, vol. 29(4), pages 37-60, Fall.
    24. Argyle, Lisa P. & Busby, Ethan C. & Fulda, Nancy & Gubler, Joshua R. & Rytting, Christopher & Wingate, David, 2023. "Out of One, Many: Using Language Models to Simulate Human Samples," Political Analysis, Cambridge University Press, vol. 31(3), pages 337-351, July.
    25. Charles F. Manski, 2004. "Measuring Expectations," Econometrica, Econometric Society, vol. 72(5), pages 1329-1376, September.
    26. Yijie Wang & Hao Gao & Campbell R. Harvey & Yan Liu & Xinyuan Tao, 2026. "Machine Learning Meets Markowitz," NBER Working Papers 34861, National Bureau of Economic Research, Inc.
    27. John J. Horton & Apostolos Filippas & Benjamin S. Manning, 2023. "Large Language Models as Simulated Economic Agents: What Can We Learn from Homo Silicus?," NBER Working Papers 31122, National Bureau of Economic Research, Inc.
    28. Peiyao Li & Noah Castelo & Zsolt Katona & Miklos Sarvary, 2024. "Frontiers: Determining the Validity of Large Language Models for Automated Perceptual Analysis," Marketing Science, INFORMS, vol. 43(2), pages 254-266, March.
    29. Shihao Gu & Bryan Kelly & Dacheng Xiu, 2020. "Empirical Asset Pricing via Machine Learning," The Review of Financial Studies, Society for Financial Studies, vol. 33(5), pages 2223-2273.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zarifhonarvar, Ali, 2026. "Generating inflation expectations with large language models," Journal of Monetary Economics, Elsevier, vol. 157(C).
    2. Nikoleta Anesti & Edward Hill & Andreas Joseph, 2025. "Inflation Attitudes of Large Language Models," Papers 2512.14306, arXiv.org.
    3. An, Suwei, 2023. "Essays on incentive contracts, M&As, and firm risk," Other publications TiSEM dd97d2f5-1c9d-47c5-ba62-f, Tilburg University, School of Economics and Management.
    4. Hui Chen & Antoine Didisheim & Mohammad & Pourmohammadi & Luciano Somoza & Hanqing Tian, 2025. "A Financial Brain Scan of the LLM," Papers 2508.21285, arXiv.org, revised Feb 2026.
    5. Giuseppe Matera, 2025. "Corporate Earnings Calls and Analyst Beliefs," Papers 2511.15214, arXiv.org, revised Nov 2025.
    6. Felipe A. Csaszar & Harsh Ketkar & Hyunjin Kim, 2024. "Artificial Intelligence and Strategic Decision-Making: Evidence from Entrepreneurs and Investors," Strategy Science, INFORMS, vol. 9(4), pages 322-345, December.
    7. Obaid, Khaled & Pukthuanthong, Kuntara, 2022. "A picture is worth a thousand words: Measuring investor sentiment by combining machine learning and photos from news," Journal of Financial Economics, Elsevier, vol. 144(1), pages 273-297.
    8. Barry, John W. & Campello, Murillo & Graham, John R. & Ma, Yueran, 2022. "Corporate flexibility in a time of crisis," Journal of Financial Economics, Elsevier, vol. 144(3), pages 780-806.
    9. Allen Yikuan Huang & Zheqi Fan, 2026. "Beyond Prompting: An Autonomous Framework for Systematic Factor Investing via Agentic AI," Papers 2603.14288, arXiv.org, revised Apr 2026.
    10. Avramov, Doron & Li, Minwen & Wang, Hao, 2021. "Predicting corporate policies using downside risk: A machine learning approach," Journal of Empirical Finance, Elsevier, vol. 63(C), pages 1-26.
    11. An, Suwei & Liu, Yi & Tan, Xiaofen & Wu, Kai, 2024. "Manager sentiment, deal characteristics, and takeover performance," The British Accounting Review, Elsevier, vol. 56(6).
    12. Goodell, John W. & Kumar, Satish & Lim, Weng Marc & Pattnaik, Debidutta, 2021. "Artificial intelligence and machine learning in finance: Identifying foundations, themes, and research clusters from bibliometric analysis," Journal of Behavioral and Experimental Finance, Elsevier, vol. 32(C).
    13. Park, Yang-Ho, 2022. "Spread position as a leading economic indicator," Journal of Financial Markets, Elsevier, vol. 59(PA).
    14. Matthew O. Jackson & Qiaozhu Me & Stephanie W. Wang & Yutong Xie & Walter Yuan & Seth Benzell & Erik Brynjolfsson & Colin F. Camerer & James Evans & Brian Jabarian & Jon Kleinberg & Juanjuan Meng & Se, 2025. "AI Behavioral Science," Papers 2509.13323, arXiv.org, revised May 2026.
    15. Istrefi, Klodiana & Odendahl, Florens & Sestieri, Giulia, 2023. "Fed communication on financial stability concerns and monetary policy decisions: Revelations from speeches," Journal of Banking & Finance, Elsevier, vol. 151(C).
    16. Massenot, Baptiste & Pettinicchi, Yuri, 2019. "Can households see into the future? Survey evidence from the Netherlands," Journal of Economic Behavior & Organization, Elsevier, vol. 164(C), pages 77-90.
    17. Gonzalo Ballestero & Hadi Hosseini & Samarth Khanna & Ran I. Shorrer, 2026. "Strategic Algorithmic Monoculture: Experimental Evidence from Coordination Games," Papers 2604.09502, arXiv.org, revised Apr 2026.
    18. Zhenyu Gao & Wenxi Jiang & Yutong Yan, 2026. "Debiasing LLMs by Fine-tuning," Papers 2604.02921, arXiv.org, revised May 2026.
    19. Didisheim, Antoine & Fraschini, Martina & Somoza, Luciano, 2025. "AI’s predictable memory in financial analysis," Economics Letters, Elsevier, vol. 256(C).
    20. Zongwu Cai & Pixiong Chen, 2022. "New Online Investor Sentiment and Asset Returns," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202216, University of Kansas, Department of Economics, revised Nov 2022.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2606.13812. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: https://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.