Total Recall? Evaluating the Macroeconomic Knowledge of Large Language Models
Author
Abstract
Suggested Citation
DOI: 10.17016/FEDS.2025.044
Download full text from publisher
References listed on IDEAS
- Paul Glasserman & Caden Lin, 2023. "Assessing Look-Ahead Bias in Stock Return Predictions Generated By GPT Sentiment Analysis," Papers 2309.17322, arXiv.org.
- Alejandro Lopez-Lira & Yuehua Tang & Mingyin Zhu, 2025. "The Memorization Problem: Can We Trust LLMs' Economic Forecasts?," Papers 2504.14765, arXiv.org.
- Van Pham & Scott Cunningham, 2024. "Can Base ChatGPT be Used for Forecasting without Additional Optimization?," Papers 2404.07396, arXiv.org, revised Jul 2024.
- Anton Korinek, 2023. "Generative AI for Economic Research: Use Cases and Implications for Economists," Journal of Economic Literature, American Economic Association, vol. 61(4), pages 1281-1317, December.
- Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," Papers 2404.11794, arXiv.org, revised Apr 2024.
- Benjamin S. Manning & Kehang Zhu & John J. Horton, 2024. "Automated Social Science: Language Models as Scientist and Subjects," NBER Working Papers 32381, National Bureau of Economic Research, Inc.
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Alejandro Lopez-Lira & Yuehua Tang & Mingyin Zhu, 2025. "The Memorization Problem: Can We Trust LLMs' Economic Forecasts?," Papers 2504.14765, arXiv.org.
- Dong, Mengming Michael & Stratopoulos, Theophanis C. & Wang, Victor Xiaoqi, 2024.
"A scoping review of ChatGPT research in accounting and finance,"
International Journal of Accounting Information Systems, Elsevier, vol. 55(C).
- Mengming Michael Dong & Theophanis C. Stratopoulos & Victor Xiaoqi Wang, 2024. "A Scoping Review of ChatGPT Research in Accounting and Finance," Papers 2412.05731, arXiv.org.
- Yikai Zhao & Jun Nagayasu & Xinyi Geng, 2024. "Measuring Climate Policy Uncertainty with LLMs: New Insights into Corporate Bond Credit Spreads," DSSR Discussion Papers 143, Graduate School of Economics and Management, Tohoku University.
- Sugat Chaturvedi & Rochana Chaturvedi, 2025. "Who Gets the Callback? Generative AI and Gender Bias," Papers 2504.21400, arXiv.org.
- Alejandro Lopez-Lira, 2025. "Can Large Language Models Trade? Testing Financial Theories with LLM Agents in Market Simulations," Papers 2504.10789, arXiv.org.
- Jian-Qiao Zhu & Haijiang Yan & Thomas L. Griffiths, 2024. "Language Models Trained to do Arithmetic Predict Human Risky and Intertemporal Choice," Papers 2405.19313, arXiv.org, revised May 2025.
- Felipe A. Csaszar & Harsh Ketkar & Hyunjin Kim, 2024. "Artificial Intelligence and Strategic Decision-Making: Evidence from Entrepreneurs and Investors," Papers 2408.08811, arXiv.org.
- Can Celebi & Stefan Penczynski, 2024. "Using Large Language Models for Text Classification in Experimental Economics," Working Paper series, University of East Anglia, Centre for Behavioural and Experimental Social Science (CBESS) 24-01, School of Economics, University of East Anglia, Norwich, UK..
- Manish Jha & Jialin Qian & Michael Weber & Baozhong Yang, 2024. "Harnessing Generative AI for Economic Insights," Papers 2410.03897, arXiv.org, revised Feb 2025.
- Alex Kim & Maximilian Muhn & Valeri Nikolaev, 2024. "Financial Statement Analysis with Large Language Models," Papers 2407.17866, arXiv.org, revised Feb 2025.
- Julian Junyan Wang & Victor Xiaoqi Wang, 2025. "Assessing Consistency and Reproducibility in the Outputs of Large Language Models: Evidence Across Diverse Finance and Accounting Tasks," Papers 2503.16974, arXiv.org, revised Jun 2025.
- Albanesi, Stefania & Dias da Silva, Antonio & Jimeno, Juan Francisco & Lamo, Ana & Wabitsch, Alena, 2023.
"New Technologies and Jobs in Europe,"
CEPR Discussion Papers
18220, C.E.P.R. Discussion Papers.
- Albanesi, Stefania & Da Silva, António Dias & Jimeno, Juan F. & Lamo, Ana & Wabitsch, Alena, 2023. "New technologies and jobs in Europe," Working Paper Series 2831, European Central Bank.
- Stefania Albanesi & António Dias da Silva & Juan F. Jimeno & Ana Lamo & Alena Wabitsch, 2023. "New Technologies and Jobs in Europe," NBER Working Papers 31357, National Bureau of Economic Research, Inc.
- Stefania Albanesi, 2023. "New Technologies and Jobs in Europe," Working Papers 2023-01, University of Miami, Department of Economics.
- Albanesi, Stefania & Silva, António Dias da & Jimeno, Juan F. & Lamo, Ana & Wabitsch, Alena, 2023. "New Technologies and Jobs in Europe," IZA Discussion Papers 16227, Institute of Labor Economics (IZA).
- Stefania Albanesi & António Dias da Silva & Juan F. Jimeno & Ana Lamo & Alena Wabitsch, 2024. "New Technologies and Jobs in Europe," Opportunity and Inclusive Growth Institute Working Papers 105, Federal Reserve Bank of Minneapolis.
- Stefania Albanesi & António Dias da Silva & Juan F. Jimeno & Ana Lamo & Alena Wabitsch, 2023. "New technologies and jobs in Europe," Working Papers 2322, Banco de España.
- Shuaiyu Chen & T. Clifton Green & Huseyin Gulen & Dexin Zhou, 2024. "What Does ChatGPT Make of Historical Stock Returns? Extrapolation and Miscalibration in LLM Stock Return Forecasts," Papers 2409.11540, arXiv.org.
- Breitung, Christian & Müller, Sebastian, 2025. "Global Business Networks," Journal of Financial Economics, Elsevier, vol. 166(C).
- Wagner Marco, 2024. "Künstliche Intelligenz: ChatGPT bei EZB-Prognosen," Wirtschaftsdienst, Sciendo, vol. 104(9), pages 592-592.
- Kim Shin Young & Sang-Gun Lee & Ga Youn Hong, 2024. "User satisfaction with the service quality of ChatGPT," Service Business, Springer;Pan-Pacific Business Association, vol. 18(3), pages 417-431, December.
- Zareh Asatryan & Carlo Birkholz & Friedrich Heinemann, 2025.
"Evidence-based policy or beauty contest? An LLM-based meta-analysis of EU cohesion policy evaluations,"
International Tax and Public Finance, Springer;International Institute of Public Finance, vol. 32(2), pages 625-655, April.
- Asatryan, Zareh & Birkholz, Carlo & Heinemann, Friedrich, 2024. "Evidence-based policy or beauty contest? An LLM-based meta-analysis of EU cohesion policy evaluations," ZEW Discussion Papers 24-037, ZEW - Leibniz Centre for European Economic Research.
- Garg, Prashant & Fetzer, Thiemo, 2024.
"Causal Claims in Economics,"
OSF Preprints
u4vgs, Center for Open Science.
- Prashant Garg & Thiemo Fetzer, 2025. "Causal Claims in Economics," Papers 2501.06873, arXiv.org.
- Garg, Prashant & Fetzer, Thiemo, 2024. "Causal Claims in Economics," I4R Discussion Paper Series 183, The Institute for Replication (I4R).
- Prashant Garg & Thiemo Fetzer, 2024. "Causal Claims in Economics," CESifo Working Paper Series 11462, CESifo.
- Buchanan, Joy & Hickman, William, 2024. "Do people trust humans more than ChatGPT?," Journal of Behavioral and Experimental Economics (formerly The Journal of Socio-Economics), Elsevier, vol. 112(C).
- Fetzer, Thiemo & Lambert, Peter John & Feld, Bennet & Garg, Prashant, 2024.
"AI-Generated Production Networks : Measurement and Applications to Global Trade,"
The Warwick Economics Research Paper Series (TWERPS)
1528, University of Warwick, Department of Economics.
- Fetzer, Thiemo & Lambert, Peter John & Feld, Bennet & Garg, Prashant, 2024. "AI-Generated Production Networks: Measurement and Applications to Global Trade," CAGE Online Working Paper Series 733, Competitive Advantage in the Global Economy (CAGE).
- Thiemo Fetzer & Peter John Lambert & Bennet Feld & Prashant Garg, 2024. "AI-Generated Production Networks: Measurement and Applications to Global Trade," CESifo Working Paper Series 11497, CESifo.
- Thiemo Fetzer & Peter John Lambert & Bennet Feld & Prashant Garg, 2024. "AI-Generated Production Networks: Measurement and Applications to Global Trade," ECONtribute Discussion Papers Series 346, University of Bonn and University of Cologne, Germany.
More about this item
Keywords
; ; ; ;JEL classification:
- C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
- C80 - Mathematical and Quantitative Methods - - Data Collection and Data Estimation Methodology; Computer Programs - - - General
- E37 - Macroeconomics and Monetary Economics - - Prices, Business Fluctuations, and Cycles - - - Forecasting and Simulation: Models and Applications
NEP fields
This paper has been announced in the following NEP Reports:- NEP-AIN-2025-07-14 (Artificial Intelligence)
- NEP-BIG-2025-07-14 (Big Data)
- NEP-CMP-2025-07-14 (Computational Economics)
- NEP-FOR-2025-07-14 (Forecasting)
- NEP-HIS-2025-07-14 (Business, Economic and Financial History)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgfe:2025-44. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.