IDEAS home Printed from https://ideas.repec.org/p/fpr/ifprid/183571.html

Large language models as measurement instruments in applied economics: A 10-country public-discourse panel on food and nutrition security in Africa, 2010–2025

Author

Listed:
  • Ulimwengu, John M.

Abstract

Large language models (LLM) are increasingly used in applied economics to convert unstructured text into structured empirical measures. This paper examines their use as measurement instruments through a 10-country public-discourse panel on food and nutrition security in Africa from 2010 to 2025. The panel covers Somalia, South Sudan, Sudan, Democratic Republic of the Congo, Nigeria, Ethiopia, Kenya, Niger, Mali, and Burkina Faso, and contains 206 document-level records drawn from public early-warning, humanitarian, government, and technical sources. Each record is organized by country, date, source type, geography, benchmark type, benchmark phase where available, leakage risk, and a set of generated coding variables describing food-security dimension, text severity, narrative frame, tone, attribution, and evidence type. The paper treats LLM-coded outputs not as ground truth, but as generated variables subject to measurement error, source-selection bias, benchmark leakage, and uncertainty arising from incomplete or uneven source text. A conservative validation sample is limited to records with completed source-grounded excerpts, while an exploratory validation sample uses the broader metadata-supported corpus to examine phase coverage across benchmark categories. The results illustrate both the promise and the limits of LLM-assisted public-discourse measurement. Public documents can be transformed into transparent, auditable indicators of food-security stress, but their validity depends on document sampling, excerpt quality, benchmark independence, source diversity, and careful distinction between technical classifications and independent discourse. The paper contributes to the emerging literature on LLMs in economics by shifting attention from general productivity uses toward the practical conditions under which LLM-assisted text measurement can support applied research and policy analysis. A reproducibility package accompanies the study and includes the coded data, validation samples, codebook, data dictionary, AI-use disclosure, leakage documentation, and scripts for reproducing the descriptive results.

Suggested Citation

  • Ulimwengu, John M., 2026. "Large language models as measurement instruments in applied economics: A 10-country public-discourse panel on food and nutrition security in Africa, 2010–2025," IFPRI discussion papers 2427, International Food Policy Research Institute (IFPRI).
  • Handle: RePEc:fpr:ifprid:183571
    as

    Download full text from publisher

    File URL: https://hdl.handle.net/10568/183571
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fpr:ifprid:183571. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: the person in charge (email available below). General contact details of provider: https://edirc.repec.org/data/ifprius.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.