IDEAS home Printed from https://ideas.repec.org/a/dba/gjsiaa/v3y2026i1p45-64.html

BIM-Specific Language-Model Pipelines for IFC Code Generation and Building Component Question Answering: A Full-Corpus Comparison of Zero-Shot, RAG, and Supervised Fine-Tuning

Author

Listed:
  • Reed, Marcus
  • Zhang, Julia

Abstract

Natural-language access to Building Information Modeling (BIM) requires two complementary capabilities: generating structurally correct Industry Foundation Classes (IFC) code and answering questions about building entities, properties, constraints, materials, and interoperability workflows. This study compares zero-shot generation, retrieval-augmented generation (RAG), and supervised fine-tuning on the 42,680-record IFC-BIM High-Quality Alpaca corpus. A deterministic family-stratified 80/10/10 split assigned every record to training, validation, or testing. The corpus comprised 28,513 unique 36-statement IfcWall DATA fragments and 14,167 question-answer records distributed across 14 observed families. All three approaches used the same task-specific output constraints, so the comparison isolates the source of adaptation rather than changes in grammar. On 2,852 held-out code instructions, zero-shot generation achieved 0.18% pass@1 and 54.97% mean field accuracy. Top-1 RAG reached 68.62% pass@1 and 95.51% field accuracy, while the fine-tuned generator reached 100% on both measures. RAG errors were limited to the non-literal LoadBearing and IsExternal Boolean fields; majority voting over five retrieved neighbors increased pass@1 to 86.01%. On 1,417 held-out component questions, RAG produced the highest token F1 (85.19%), ROUGE-L (83.52%), and formal-constraint expression accuracy (52.38%). Fine-tuning produced the highest structured field accuracy (93.77%), exact match (60.83%), and IFC-term precision (89.13%). The findings show that supervised adaptation is decisive for regular closed-schema code generation, whereas retrieval remains valuable for detailed explanations and rare symbolic expressions. A practical BIM assistant should combine supervised routing, evidence retrieval, schema-constrained decoding, and executable validation rather than applying one adaptation mechanism to every task.

Suggested Citation

  • Reed, Marcus & Zhang, Julia, 2026. "BIM-Specific Language-Model Pipelines for IFC Code Generation and Building Component Question Answering: A Full-Corpus Comparison of Zero-Shot, RAG, and Supervised Fine-Tuning," Global Journal of Science & Innovation, Pinnacle Academic Press, vol. 3(1), pages 45-64.
  • Handle: RePEc:dba:gjsiaa:v:3:y:2026:i:1:p:45-64
    as

    Download full text from publisher

    File URL: https://pinnaclepubs.com/index.php/GJSI/article/view/975/935
    Download Restriction: no
    ---><---

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dba:gjsiaa:v:3:y:2026:i:1:p:45-64. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    We have no bibliographic references for this item. You can help adding them by using this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joseph Clark (email available below). General contact details of provider: https://pinnaclepubs.com/index.php/GJSI .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.