IDEAS home Printed from https://ideas.repec.org/a/gam/jdataj/v11y2026i8p196-d2008730.html

The ArchiveGene Corpus: A Synthetic Multi-Layer Benchmark for Genealogical Information Extraction from Uzbek Historical Archival Texts

Author

Listed:
  • Adilbek Dauletov

    (Department of Digital Technologies/Language Teaching Center, Alfraganus University, Tashkent 100190, Uzbekistan)

  • Noila Matyakubova

    (Department of Digital Technologies/Language Teaching Center, Alfraganus University, Tashkent 100190, Uzbekistan)

  • Sevara Allabergenova

    (Department of Natural Sciences, National Research Nuclear University Tashkent Branch of the National Research Nuclear University MEPhI (Moscow Engineering Physics Institute), Tashkent 100214, Uzbekistan)

  • Nargisa Ashirmatova

    (Department of Natural Sciences, National Research Nuclear University Tashkent Branch of the National Research Nuclear University MEPhI (Moscow Engineering Physics Institute), Tashkent 100214, Uzbekistan)

  • Miyassar Tillayeva

    (Department of Uzbek Linguistics, Urgench State University Named After Abu Rayhon Beruni, Urgench 220100, Uzbekistan)

  • Sevara Yoqubova

    (Department of Uzbek Language and Literature, Uzbekistan National Pedagogical University Named After Nizami, Tashkent 100185, Uzbekistan)

  • Ikrom Islomov

    (Department of Philology, Renaissance University of Education, Tashkent 100071, Uzbekistan)

Abstract

Automatic extraction of genealogical information from historical archival-genealogical documents in Uzbek is an understudied problem for low-resource languages. Multi-layer NLP benchmarks are not sufficient to automatically identify individuals, family relationships, dates, place names, and archival identifiers in such texts. Also, the same people are mentioned in various forms: full name, pronoun (18.8%), initial, surname-name order, indirect expression (9.4%), and title. Existing NER and relation extraction corpora are mainly focused on high-resource languages or general domain texts and do not sufficiently cover the FAMILY_ROLE signals, historical spelling variants, and fond–opis–delos identifiers specific to Uzbek archival-genealogical texts. Proposed resource: We present the ArchiveGene Corpus, a controlled, fully synthetic, and reproducible five-layer resource consisting of 1000 Uzbek archival-genealogical-style documents, divided into 700 training, 150 validation, and 150 test documents. The corpus contains 8366 named entities, 10,625 person mentions, 2000 coreference chains, and 1000 genealogical relation triples. The dataset was generated using a deterministic template-based pipeline and a lexicon of Uzbek names, and is fully reproducible. Inter-annotator agreement values were 0.847 for NER, 0.793 for coreference, and 0.821 for RE, according to Cohen’s κ. Comparative results are presented with four baseline models (rule-based, BiLSTM-CRF, mBERT, and XLM-RoBERTa). The dataset is openly hosted on the Zenodo platform under the CC BY 4.0 license; concept DOI: 10.5281/zenodo.20670360, v1.1.1 version DOI: 10.5281/zenodo. 21429998. Scientific significance: To the best of our knowledge, ArchiveGene is among the first openly released, controlled synthetic resources for Uzbek that integrates named-entity recognition, person-mention detection, coreference resolution, genealogical relation extraction, and final tuple generation within a single annotation framework. The baseline analysis provides three main conclusions: (1) on the clean synthetic test set, the transformer models already reach 100.00 Micro-F1 for NER and 100.00 Macro-F1 for coreference-aware relation extraction, so coreference aggregation adds little on synthetic data (+2.25 for mBERT and +0.04 for XLM-RoBERTa) but its contribution is expected to grow on real archival text; (2) the rule-based and heuristic baselines lag far behind (Macro-F1 50.28 and 70.73) and fail entirely on spouse_of, showing the limits of lexical rules; and (3) a zero-shot evaluation on a real-document pilot reduces NER Micro-F1 from 100.00 to 22.17, indicating that the synthetic corpus is trivially learnable and that real-archival validation is essential.

Suggested Citation

  • Adilbek Dauletov & Noila Matyakubova & Sevara Allabergenova & Nargisa Ashirmatova & Miyassar Tillayeva & Sevara Yoqubova & Ikrom Islomov, 2026. "The ArchiveGene Corpus: A Synthetic Multi-Layer Benchmark for Genealogical Information Extraction from Uzbek Historical Archival Texts," Data, MDPI, vol. 11(8), pages 1-29, August.
  • Handle: RePEc:gam:jdataj:v:11:y:2026:i:8:p:196-:d:2008730
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2306-5729/11/8/196/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2306-5729/11/8/196/
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jdataj:v:11:y:2026:i:8:p:196-:d:2008730. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.