IDEAS home Printed from https://ideas.repec.org/p/fpr/ifprid/183571.html

Large language models as measurement instruments in applied economics: A 10-country public-discourse panel on food and nutrition security in Africa, 2010–2025

Author

Listed:
  • Ulimwengu, John M.

Abstract

Large language models (LLM) are increasingly used in applied economics to convert unstructured text into structured empirical measures. This paper examines their use as measurement instruments through a 10-country public-discourse panel on food and nutrition security in Africa from 2010 to 2025. The panel covers Somalia, South Sudan, Sudan, Democratic Republic of the Congo, Nigeria, Ethiopia, Kenya, Niger, Mali, and Burkina Faso, and contains 206 document-level records drawn from public early-warning, humanitarian, government, and technical sources. Each record is organized by country, date, source type, geography, benchmark type, benchmark phase where available, leakage risk, and a set of generated coding variables describing food-security dimension, text severity, narrative frame, tone, attribution, and evidence type. The paper treats LLM-coded outputs not as ground truth, but as generated variables subject to measurement error, source-selection bias, benchmark leakage, and uncertainty arising from incomplete or uneven source text. A conservative validation sample is limited to records with completed source-grounded excerpts, while an exploratory validation sample uses the broader metadata-supported corpus to examine phase coverage across benchmark categories. The results illustrate both the promise and the limits of LLM-assisted public-discourse measurement. Public documents can be transformed into transparent, auditable indicators of food-security stress, but their validity depends on document sampling, excerpt quality, benchmark independence, source diversity, and careful distinction between technical classifications and independent discourse. The paper contributes to the emerging literature on LLMs in economics by shifting attention from general productivity uses toward the practical conditions under which LLM-assisted text measurement can support applied research and policy analysis. A reproducibility package accompanies the study and includes the coded data, validation samples, codebook, data dictionary, AI-use disclosure, leakage documentation, and scripts for reproducing the descriptive results.

Suggested Citation

  • Ulimwengu, John M., 2026. "Large language models as measurement instruments in applied economics: A 10-country public-discourse panel on food and nutrition security in Africa, 2010–2025," IFPRI discussion papers 2427, International Food Policy Research Institute (IFPRI).
  • Handle: RePEc:fpr:ifprid:183571
    as

    Download full text from publisher

    File URL: https://hdl.handle.net/10568/183571
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Elliott Ash & Stephen Hansen, 2023. "Text Algorithms in Economics," Annual Review of Economics, Annual Reviews, vol. 15(1), pages 659-688, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Slonimczyk, Fabian, 2025. "This Candidate is [MASK]. Prompt-based Sentiment Extraction and Reference Letters," MPRA Paper 126675, University Library of Munich, Germany.
    2. Tiancheng Wang & Krishna Sharma, 2026. "AI Assisted Economics Measurement From Survey: Evidence from Public Employee Pension Choice," Papers 2602.02604, arXiv.org.
    3. Torben S. D. Johansen & Julius Koschnick & Christian Vedel, 2026. "How to deal with machine learning bias in economic history," Papers 2606.28063, arXiv.org.
    4. Diego Marino-Fages & Agustina Martínez-Pozo, 2026. "Hate in the Tropics: Political Leaders and the Social Acceptability of Online Hate Speech," Working Papers 391, Red Nacional de Investigadores en Economía (RedNIE).
    5. Läpple, Doris & Thoyer, Sophie & Van den Broeck, Goedele & Lécole, Pauline & Sok, Jaap & de Mey, Yann, 2026. "Farmers’ Voices in European Protests: Diverse Complaints, Emotional Tones, and Policy Responses," Food Policy, Elsevier, vol. 138(C).
    6. Maria Saveria Mavillonio, 2024. "Natural Language Processing Techniques for Long Financial Document," Discussion Papers 2024/317, Dipartimento di Economia e Management (DEM), University of Pisa, Pisa, Italy.
    7. Ilyana Kuziemko & Nicolas Longuet-Marx & Suresh Naidu, 2024. "“Compensate the Losers?†Economic Policy and Partisan Realignment in the US," Working Papers 321, Princeton University, Department of Economics, Center for Economic Policy Studies..
    8. Storm, Eduard & Gonschor, Myrielle & Schmidt, Marc Justin, 2025. "AI in demand: How expertise shapes its (early) impact on workers," Ruhr Economic Papers 1185, RWI - Leibniz-Institut für Wirtschaftsforschung, Ruhr-University Bochum, TU Dortmund University, University of Duisburg-Essen.
    9. Rony, Sidharth, 2026. "LLM Meets Job Advertisements: Unmasking Skill Premia in the UK," MERIT Working Papers 010, United Nations University - Maastricht Economic and Social Research Institute on Innovation and Technology (MERIT).
    10. Franz Ulrich Ruch & Temel Taskin, 2024. "Global Demand and Supply Sentiment: Evidence From Earnings Calls," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 86(2), pages 314-334, April.
    11. Arold, Benjamin W. & Ash, Elliott & MacLeod, Bentley & Naidu, Suresh, 2025. "Worker Rights in Collective Bargaining," CEPR Discussion Papers 20081, Centre for Economic Policy Research.
    12. Bernd Hayo & Johannes Zahner, 2025. "Fiscal Talks: Parliamentary Debates and Government Expenditure," MAGKS Papers on Economics 202521, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).
    13. Yan, Guan & Li, Fanglin & Liu, Zhidong & Zhou, Lu Jolly, 2025. "Climate risk concern and green premium in the stock market: Evidence from China," Finance Research Letters, Elsevier, vol. 84(C).
    14. Bauer, Michael & Huber, Daniel & Offner, Eric & Renkel, Marlene & Wilms, Ole, 2024. "Corporate Green Pledges," CEPR Discussion Papers 19788, Centre for Economic Policy Research.
    15. Kris Boudt & Yanick Inghels & André Spithoven, 2025. "Mapping Economic Growth and Employment in EU-Funded Research Projects: Trac(k)ing the SDG 8 Trajectory," De Economist, Springer, vol. 173(1), pages 245-275, March.
    16. Guo, Peng & Jiang, Fuwei & Li, Mengru & Liu, Yumin, 2024. "Managerial macroeconomic perception and systemic risk in China," Pacific-Basin Finance Journal, Elsevier, vol. 88(C).
    17. Léonard Boussioux & Jacqueline N. Lane & Miaomiao Zhang & Vladimir Jacimovic & Karim R. Lakhani, 2024. "The Crowdless Future? Generative AI and Creative Problem-Solving," Organization Science, INFORMS, vol. 35(5), pages 1589-1607, September.
    18. Cormun, Vito & Ristolainen, Kim, 2026. "Exchange rate narratives," Journal of International Money and Finance, Elsevier, vol. 167(C).
    19. Lorenz Gschwent & Björn Hammarfelt & Martin Karlsson & Mathias Kifmann, 2026. "The Rise of Health Economics: Transforming the Landscape of Economic Research," Health Economics, John Wiley & Sons, Ltd., vol. 35(1), pages 52-68, January.
    20. Firmin Ayivodji & Etienne Briand & Kevin Moran & Dalibor Stevanovic, 2026. "Monetary Policy in the Media Spotlight: Sentiments, Signals, and Economic Impact," Working Papers 26-03, Chair in macroeconomics and forecasting, University of Quebec in Montreal's School of Management.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fpr:ifprid:183571. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/ifprius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.