IDEAS home Printed from https://ideas.repec.org/a/eee/reensy/v257y2025ipas0951832025000377.html
   My bibliography  Save this article

A systematic procedure for the analysis of maintenance reports based on a taxonomy and BERT attention mechanism

Author

Listed:
  • Valcamonico, Dario
  • Baraldi, Piero
  • Macêdo, July Bias
  • Moura, Márcio Das Chagas
  • Brown, Jonathan
  • Gauthier, Stéphane
  • Zio, Enrico

Abstract

This work proposes a systematic procedure for analyzing maintenance reports to support maintenance decision-making for a fleet of similar systems. The proposed procedure allows achieving three objectives: (1) grouping maintenance interventions, (2) identifying common characteristics in the maintenance interventions, and (3) recognizing occurrences of rare events of maintenance intervention. Specifically, the attention mechanism of Bidirectional Encoder Representation from Transformer (BERT) and the Density Based Spatial Clustering Applications with Noise (DBSCAN) methods are combined to group maintenance interventions according to their similarity of stated features. A taxonomy of the words used in the textual reports to state the maintenance interventions is developed to systematically identify common features of the clusters, such as the involved components, their working state, the occurred failures or malfunctions, the performed maintenance actions and the personnel that has performed the intervention. The proposed procedure is applied to a repository of reports of maintenance interventions performed on mechanical and electric components of traction systems of a fleet of trains. The obtained results show that it can effectively support decision-making on the maintenance of traction systems.

Suggested Citation

  • Valcamonico, Dario & Baraldi, Piero & Macêdo, July Bias & Moura, Márcio Das Chagas & Brown, Jonathan & Gauthier, Stéphane & Zio, Enrico, 2025. "A systematic procedure for the analysis of maintenance reports based on a taxonomy and BERT attention mechanism," Reliability Engineering and System Safety, Elsevier, vol. 257(PA).
    • Handle: RePEc:eee:reensy:v:257:y:2025:i:pa:s0951832025000377
    DOI: 10.1016/j.ress.2025.110834
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0951832025000377
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.ress.2025.110834?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Jintao & Schmid, Felix & Li, Keping & Zheng, Wei, 2021. "A knowledge graph-based approach for exploring railway operational accidents," Reliability Engineering and System Safety, Elsevier, vol. 207(C).
    2. Rose, Rodrigo L. & Puranik, Tejas G. & Mavris, Dimitri N. & Rao, Arjun H., 2022. "Application of structural topic modeling to aviation safety data," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    3. Daniil A. Boiko & Robert MacKnight & Ben Kline & Gabe Gomes, 2023. "Autonomous chemical research with large language models," Nature, Nature, vol. 624(7992), pages 570-578, December.
    4. Song, Bing & Zhang, Zhipeng & Qin, Yong & Liu, Xiang & Hu, Hao, 2022. "Quantitative analysis of freight train derailment severity with structured and unstructured data," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    5. Juan Pablo Usuga-Cadavid & Samir Lamouri & Bernard Grabot & Arnaud Fortin, 2022. "Using deep learning to value free-form text data for predictive maintenance," International Journal of Production Research, Taylor & Francis Journals, vol. 60(14), pages 4548-4575, July.
    6. Zheng, Shuwen & Pan, Kai & Liu, Jie & Chen, Yunxia, 2024. "Empirical study on fine-tuning pre-trained large language models for fault diagnosis of complex systems," Reliability Engineering and System Safety, Elsevier, vol. 252(C).
    7. Bhardwaj, U. & Teixeira, A.P. & Guedes Soares, C., 2022. "Casualty analysis methodology and taxonomy for FPSO accident analysis," Reliability Engineering and System Safety, Elsevier, vol. 218(PB).
    8. Robert C Nickerson & Upkar Varshney & Jan Muntermann, 2013. "A method for taxonomy development and its application in information systems," European Journal of Information Systems, Taylor & Francis Journals, vol. 22(3), pages 336-359, May.
    9. Valcamonico, Dario & Baraldi, Piero & Zio, Enrico & Decarli, Luca & Crivellari, Anna & Rosa, Laura La, 2024. "Combining natural language processing and bayesian networks for the probabilistic estimation of the severity of process safety events in hydrocarbon production assets," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    10. Li, Yan-Fu & Wang, Huan & Sun, Muxia, 2024. "ChatGPT-like large-scale foundation models for prognostics and health management: A survey and roadmaps," Reliability Engineering and System Safety, Elsevier, vol. 243(C).
    11. Yang, Zhe & Baraldi, Piero & Zio, Enrico, 2020. "A novel method for maintenance record clustering and its application to a case study of maintenance optimization," Reliability Engineering and System Safety, Elsevier, vol. 203(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Valcamonico, Dario & Baraldi, Piero & Zio, Enrico & Decarli, Luca & Crivellari, Anna & Rosa, Laura La, 2024. "Combining natural language processing and bayesian networks for the probabilistic estimation of the severity of process safety events in hydrocarbon production assets," Reliability Engineering and System Safety, Elsevier, vol. 241(C).
    2. Karimi Dehkordi, Mohammadreza & Sattari, Fereshteh & Lefsrud, Lianne, 2025. "Creating an incident investigation framework for a complex socio-technical system: Application of multi-label text classification and Bayesian network structure learning," Reliability Engineering and System Safety, Elsevier, vol. 260(C).
    3. Huang, Yujie & Zhang, Zhipeng & Hu, Hao, 2025. "Risk propagation mechanisms in railway systems under extreme weather: A knowledge graph-based unsupervised causation chain approach," Reliability Engineering and System Safety, Elsevier, vol. 260(C).
    4. Zhang, Hengqi & Geng, Hua, 2023. "A methodology to identify and assess high-risk causes for electrical personal accidents based on directed weighted CN," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    5. Liu, Jintao & Ji, Lin & Chen, Keyi & Li, Chenling & Duan, Huayu, 2025. "Railway operational hazard prediction and control based on knowledge graph embedding and topological analysis," Reliability Engineering and System Safety, Elsevier, vol. 258(C).
    6. Thorsten Schoormann & Julia Schweihoff & Ilka Jussen & Frederik Möller, 2023. "Classification tools for business models: Status quo, comparison, and agenda," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-36, December.
    7. Maggie Wang, Yazhu & Matook, Sabine & Dennis, Alan R., 2024. "Unintended consequences of humanoid service robots: A case study of public service organizations," Journal of Business Research, Elsevier, vol. 174(C).
    8. Melina Panzner & Sebastian Enzberg & Maurice Meyer & Roman Dumitrescu, 2024. "Characterization of Usage Data with the Help of Data Classifications," Journal of the Knowledge Economy, Springer;Portland International Center for Management of Engineering and Technology (PICMET), vol. 15(1), pages 88-109, March.
    9. Jochen Wulf & Juerg Meierhofer, 2023. "Towards a Taxonomy of Large Language Model based Business Model Transformations," Papers 2311.05288, arXiv.org.
    10. Alexander Grünewald & Tan Gürpinar & Carina Culotta & Alicia Guderian, 2024. "Archetypes of blockchain-based business models in enterprise networks," Information Systems and e-Business Management, Springer, vol. 22(4), pages 633-665, December.
    11. repec:osf:osfxxx:w5xj6_v1 is not listed on IDEAS
    12. Wang, Hui & Zheng, Junkang & Xiang, Jiawei, 2023. "Online bearing fault diagnosis using numerical simulation models and machine learning classifications," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    13. Simon Scheider & Florian Lauf & Simon Geller & Frederik Möller & Boris Otto, 2023. "Exploring design elements of personal data markets," Electronic Markets, Springer;IIM University of St. Gallen, vol. 33(1), pages 1-16, December.
    14. Fozer, Daniel & Owsianiak, Mikołaj & Hauschild, Michael Zwicky, 2025. "Quantifying environmental learning and scaling rates for prospective life cycle assessment of e-ammonia production," Renewable and Sustainable Energy Reviews, Elsevier, vol. 213(C).
    15. Nina Thornton & Martin Engert & Andreas Hein & Helmut Krcmar, 2023. "Finding new purpose for vacancies in rural areas: a taxonomy of coworking space business models," International Entrepreneurship and Management Journal, Springer, vol. 19(3), pages 1395-1423, September.
    16. Braga, Joaquim A.P. & Andrade, António R., 2021. "Multivariate statistical aggregation and dimensionality reduction techniques to improve monitoring and maintenance in railways: The wheelset component," Reliability Engineering and System Safety, Elsevier, vol. 216(C).
    17. Gursel, Ezgi & Madadi, Mahboubeh & Coble, Jamie Baalis & Agarwal, Vivek & Yadav, Vaibhav & Boring, Ronald L. & Khojandi, Anahita, 2025. "The role of AI in detecting and mitigating human errors in safety-critical industries: A review," Reliability Engineering and System Safety, Elsevier, vol. 256(C).
    18. Michael Stewart & Melinda Hodkiewicz & Wei Liu & Tim French, 2024. "MWO2KG and Echidna: Constructing and exploring knowledge graphs from maintenance data," Journal of Risk and Reliability, , vol. 238(5), pages 920-932, October.
    19. Zhou, Di & Zhuang, Xiao & Zuo, Hongfu & Cai, Jing & Zhao, Xufeng & Xiang, Jiawei, 2022. "A model fusion strategy for identifying aircraft risk using CNN and Att-BiLSTM," Reliability Engineering and System Safety, Elsevier, vol. 228(C).
    20. Sarvesh Sundaram & Abe Zeid, 2025. "Technical language processing for Prognostics and Health Management: applying text similarity and topic modeling to maintenance work orders," Journal of Intelligent Manufacturing, Springer, vol. 36(3), pages 1637-1657, March.
    21. Patrick Zschech, 2023. "Beyond descriptive taxonomies in data analytics: a systematic evaluation approach for data-driven method pipelines," Information Systems and e-Business Management, Springer, vol. 21(1), pages 193-227, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:reensy:v:257:y:2025:i:pa:s0951832025000377. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: https://www.journals.elsevier.com/reliability-engineering-and-system-safety .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.