IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2511.17866.html

Narratives to Numbers: Large Language Models and Economic Policy Uncertainty

Author

Listed:
  • Ethan Hartley

Abstract

This study evaluates large language models as estimable classifiers and clarifies how modeling choices shape downstream measurement error. Revisiting the Economic Policy Uncertainty index, we show that contemporary classifiers substantially outperform dictionary rules, better track human audit assessments, and extend naturally to noisy historical and multilingual news. We use these tools to construct a new nineteenth-century U.S. index from more than 360 million newspaper articles and exploratory cross-country indices with a single multilingual model. Taken together, our results show that LLMs can systematically improve text-derived measures and should be integrated as explicit measurement tools in empirical economics.

Suggested Citation

  • Ethan Hartley, 2025. "Narratives to Numbers: Large Language Models and Economic Policy Uncertainty," Papers 2511.17866, arXiv.org, revised Nov 2025.
  • Handle: RePEc:arx:papers:2511.17866
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2511.17866
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Matthew Gentzkow & Jesse M. Shapiro, 2010. "What Drives Media Slant? Evidence From U.S. Daily Newspapers," Econometrica, Econometric Society, vol. 78(1), pages 35-71, January.
    2. Ito, Arata & Sato, Masahiro & Ota, Rui, 2025. "A novel content-based approach to measuring monetary policy uncertainty using fine-tuned LLMs," Finance Research Letters, Elsevier, vol. 75(C).
    3. Mr. Gee Hee Hong & Shikun (Barry) Ke & Anh D. M. Nguyen, 2024. "The Economic Impact of Fiscal Policy Uncertainty: Evidence from a New Cross-Country Database," IMF Working Papers 2024/209, International Monetary Fund.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bernhardt, Lea & Dewenter, Ralf & Thomas, Tobias, 2023. "Measuring partisan media bias in US newscasts from 2001 to 2012," European Journal of Political Economy, Elsevier, vol. 78(C).
    2. Simon P. Anderson & John McLaren, 2012. "Media Mergers And Media Bias With Rational Consumers," Journal of the European Economic Association, European Economic Association, vol. 10(4), pages 831-859, August.
    3. Mueller, Hannes & Rauh, Christopher, 2018. "Reading Between the Lines: Prediction of Political Violence Using Newspaper Text," American Political Science Review, Cambridge University Press, vol. 112(2), pages 358-375, May.
    4. McCannon, Bryan & Zhou, Yang & Hall, Joshua, 2021. "Measuring a Contract’s Breadth: A Text Analysis," Working Papers 11013, George Mason University, Mercatus Center.
    5. Nathan, Max & Rosso, Anna, 2014. "Mapping information economy businesses with big data: findings from the UK," LSE Research Online Documents on Economics 60615, London School of Economics and Political Science, LSE Library.
    6. Ghosh, Saptarshi P. & Jain, Nidhi & Martinelli, Ćesar & Roy, Jaideep, 2023. "Responsive democracy and commercial media," Economics Letters, Elsevier, vol. 222(C).
    7. Hungerman, Daniel & Rinz, Kevin & Weninger, Tim & Yoon, Chungeun, 2018. "Political campaigns and church contributions," Journal of Economic Behavior & Organization, Elsevier, vol. 155(C), pages 403-426.
    8. Giovanni Facchini & Anna Maria Mayda & Riccardo Puglisi, 2017. "Illegal immigration and media exposure: evidence on individual attitudes," IZA Journal of Migration and Development, Springer;Forschungsinstitut zur Zukunft der Arbeit GmbH (IZA), vol. 7(1), pages 1-36, December.
    9. Pal Sudeshna, 2011. "Media Freedom and Socio-Political Instability," Peace Economics, Peace Science, and Public Policy, De Gruyter, vol. 17(1), pages 1-23, March.
    10. Sharma, Priyanka & Wagman, Liad, 2020. "Advertising and Voter Data in Asymmetric Political Contests," Information Economics and Policy, Elsevier, vol. 52(C).
    11. David Bholat & Stephen Hans & Pedro Santos & Cheryl Schonhardt-Bailey, 2015. "Text mining for central banks," Handbooks, Centre for Central Banking Studies, Bank of England, number 33, April.
    12. Tim Munday & James Brookes, 2021. "Mark my words: the transmission of central bank communication to the general public via the print media," Bank of England working papers 944, Bank of England.
    13. Ester Faia & Andreas Fuster & Vincenzo Pezone & Basit Zafar, 2024. "Biases in Information Selection and Processing: Survey Evidence from the Pandemic," The Review of Economics and Statistics, MIT Press, vol. 106(3), pages 829-847, May.
    14. Popov, Vladimir, 2014. "Puzzles of public opinion: Why Soviet population supports the transition to capitalism since the 1980S," MPRA Paper 60915, University Library of Munich, Germany.
    15. Tarek A Hassan & Stephan Hollander & Laurence van Lent & Ahmed Tahoun, 2019. "Firm-Level Political Risk: Measurement and Effects," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 134(4), pages 2135-2202.
    16. Shane Greenstein & Yuan Gu & Feng Zhu, 2016. "Ideological Segregation among Online Collaborators: Evidence from Wikipedians," Harvard Business School Working Papers 17-028, Harvard Business School, revised Mar 2017.
    17. Filipe R. Campante & Quoc-Anh Do, 2014. "Isolated Capital Cities, Accountability, and Corruption: Evidence from US States," American Economic Review, American Economic Association, vol. 104(8), pages 2456-2481, August.
    18. Hong, T., 2021. "Revisiting the Trade Policy Uncertainty Index," Cambridge Working Papers in Economics 2174, Faculty of Economics, University of Cambridge.
    19. Jetter, Michael, 2017. "Terrorism and the Media: The Effect of US Television Coverage on Al-Qaeda Attacks," IZA Discussion Papers 10708, Institute of Labor Economics (IZA).
    20. Nicola Mastrorocco & Arianna Ornaghi, 2025. "Who Watches the Watchmen? Local News and Police Behavior in the United States," American Economic Journal: Economic Policy, American Economic Association, vol. 17(2), pages 285-318, May.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2511.17866. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.