IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i10p2464-d1653422.html
   My bibliography  Save this article

Hybrid Transformer–Convolutional Neural Network Approach for Non-Intrusive Load Analysis in Industrial Processes

Author

Listed:
  • Gengsheng He

    (Energy Development Research Institute, China Southern Power Grid, Guangzhou 510530, China)

  • Yu Huang

    (Electric Power Research Institute of Guizhou Power Grid Co., Ltd., Guizhou 550002, China)

  • Ying Zhang

    (Electric Power Research Institute of Guizhou Power Grid Co., Ltd., Guizhou 550002, China
    College of Electrical Engineering, Guizhou University, Guizhou 550025, China)

  • Yuanzhe Zhu

    (Energy Development Research Institute, China Southern Power Grid, Guangzhou 510530, China)

  • Yuan Leng

    (Energy Development Research Institute, China Southern Power Grid, Guangzhou 510530, China)

  • Nan Shang

    (Energy Development Research Institute, China Southern Power Grid, Guangzhou 510530, China)

  • Jincan Zeng

    (Energy Development Research Institute, China Southern Power Grid, Guangzhou 510530, China)

  • Zengxin Pu

    (Electric Power Research Institute of Guizhou Power Grid Co., Ltd., Guizhou 550002, China)

Abstract

With global efforts intensifying towards achieving carbon neutrality, accurately monitoring and managing energy consumption in industrial sectors has become critical. Non-Intrusive Load Monitoring (NILM) technology presents a cost-effective solution for industrial energy management by decomposing aggregate power data into individual device-level information without extensive hardware requirements. However, existing NILM methods primarily tailored for residential applications struggle to capture complex inter-device correlations and production-dependent load dynamics prevalent in industrial environments, such as cement plants. This paper proposes a novel sequence-to-sequence-based non-intrusive load disaggregation method that integrates Convolutional Neural Networks (CNN) and Transformer architectures, specifically addressing the challenges of multi-device load disaggregation in industrial settings. An innovative time–application attention mechanism was integrated to effectively model long-term temporal dependencies and the collaborative operational relationships between industrial devices. Additionally, global constraints—including consistency, smoothness, and sparsity—were introduced into the loss function to ensure power conservation, reduce noise, and achieve precise zero-power predictions for inactive equipment. The proposed method was validated on real-world power consumption data collected from a cement production facility. Experimental results indicate that the proposed method significantly outperforms traditional NILM approaches with average improvements of 4.98%, 3.70%, and 4.38% in terms of accuracy, recall, and F1-score, respectively. These findings underscore its superior robustness in noisy conditions and under device fault conditions, further affirming its applicability and potential for deployment in industrial settings.

Suggested Citation

  • Gengsheng He & Yu Huang & Ying Zhang & Yuanzhe Zhu & Yuan Leng & Nan Shang & Jincan Zeng & Zengxin Pu, 2025. "Hybrid Transformer–Convolutional Neural Network Approach for Non-Intrusive Load Analysis in Industrial Processes," Energies, MDPI, vol. 18(10), pages 1-17, May.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:10:p:2464-:d:1653422
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/10/2464/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/10/2464/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Shuaibo Wang & Xinyuan Xiang & Jie Zhang & Zhuohang Liang & Shufang Li & Peilin Zhong & Jie Zeng & Chenguang Wang, 2025. "A Multi-Task Spatiotemporal Graph Neural Network for Transient Stability and State Prediction in Power Systems," Energies, MDPI, vol. 18(6), pages 1-17, March.
    2. Yubo Wang & Chao Huo & Fei Xu & Libin Zheng & Ling Hao, 2025. "Ultra-Short-Term Distributed Photovoltaic Power Probabilistic Forecasting Method Based on Federated Learning and Joint Probability Distribution Modeling," Energies, MDPI, vol. 18(1), pages 1-21, January.
    3. Antonio Ruano & Alvaro Hernandez & Jesus Ureña & Maria Ruano & Juan Garcia, 2019. "NILM Techniques for Intelligent Home Energy Management and Ambient Assisted Living: A Review," Energies, MDPI, vol. 12(11), pages 1-29, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. İsmail Hakkı Çavdar & Vahit Feryad, 2021. "Efficient Design of Energy Disaggregation Model with BERT-NILM Trained by AdaX Optimization Method for Smart Grid," Energies, MDPI, vol. 14(15), pages 1-21, July.
    2. Cristina Puente & Rafael Palacios & Yolanda González-Arechavala & Eugenio Francisco Sánchez-Úbeda, 2020. "Non-Intrusive Load Monitoring (NILM) for Energy Disaggregation Using Soft Computing Techniques," Energies, MDPI, vol. 13(12), pages 1-20, June.
    3. Hernandez-Matheus, Alejandro & Löschenbrand, Markus & Berg, Kjersti & Fuchs, Ida & Aragüés-Peñalba, Mònica & Bullich-Massagué, Eduard & Sumper, Andreas, 2022. "A systematic review of machine learning techniques related to local energy communities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 170(C).
    4. Veronica Piccialli & Antonio M. Sudoso, 2021. "Improving Non-Intrusive Load Disaggregation through an Attention-Based Deep Neural Network," Energies, MDPI, vol. 14(4), pages 1-16, February.
    5. Everton Luiz de Aguiar & André Eugenio Lazzaretti & Bruna Machado Mulinari & Daniel Rodrigues Pipa, 2021. "Scattering Transform for Classification in Non-Intrusive Load Monitoring," Energies, MDPI, vol. 14(20), pages 1-20, October.
    6. Yichao Xie & Bowen Zhou & Zhenyu Wang & Bo Yang & Liaoyi Ning & Yanhui Zhang, 2023. "Industrial Carbon Footprint (ICF) Calculation Approach Based on Bayesian Cross-Validation Improved Cyclic Stacking," Sustainability, MDPI, vol. 15(19), pages 1-35, September.
    7. Yang, Chao & Liang, Gaoqi & Liu, Jinjie & Liu, Guolong & Yang, Hongming & Zhao, Junhua & Dong, Zhaoyang, 2023. "A non-intrusive carbon emission accounting method for industrial corporations from the perspective of modern power systems," Applied Energy, Elsevier, vol. 350(C).
    8. Inoussa Laouali & Isaías Gomes & Maria da Graça Ruano & Saad Dosse Bennani & Hakim El Fadili & Antonio Ruano, 2022. "Energy Disaggregation Using Multi-Objective Genetic Algorithm Designed Neural Networks," Energies, MDPI, vol. 15(23), pages 1-29, November.
    9. Xi He & Heng Dong & Wanli Yang & Jun Hong, 2022. "A Novel Denoising Auto-Encoder-Based Approach for Non-Intrusive Residential Load Monitoring," Energies, MDPI, vol. 15(6), pages 1-15, March.
    10. Xiao-Yu Zhang & Stefanie Kuenzel & José-Rodrigo Córdoba-Pachón & Chris Watkins, 2020. "Privacy-Functionality Trade-Off: A Privacy-Preserving Multi-Channel Smart Metering System," Energies, MDPI, vol. 13(12), pages 1-30, June.
    11. Yan Tao & Xiangping Kong & Chenqing Wang & Junchao Zheng & Zijun Bin & Jinjiao Lin & Sudi Xu, 2025. "Research on Cross-Circuitry Fault Identification Method for AC/DC Transmission System Based on Blind Signal Separation Algorithm," Energies, MDPI, vol. 18(6), pages 1-16, March.
    12. Hari Prasad Devarapalli & Venkata Samba Sesha Siva Sarma Dhanikonda & Sitarama Brahmam Gunturi, 2021. "Demand-Side Management for Improvement of the Power Quality in Smart Homes Using Non-Intrusive Identification of Appliance Usage Patterns with the True Power Factor," Energies, MDPI, vol. 14(16), pages 1-19, August.
    13. Netzah Calamaro & Moshe Donko & Doron Shmilovitz, 2021. "A Highly Accurate NILM: With an Electro-Spectral Space That Best Fits Algorithm’s National Deployment Requirements," Energies, MDPI, vol. 14(21), pages 1-37, November.
    14. Miltiadis D. Lytras & Kwok Tai Chui, 2019. "The Recent Development of Artificial Intelligence for Smart and Sustainable Energy Systems and Applications," Energies, MDPI, vol. 12(16), pages 1-7, August.
    15. Jennifer Günter & Lukas Fabri & Simon Wenninger & Can Kaymakci, 2025. "Developing a Smart Energy Service Canvas," Schmalenbach Journal of Business Research, Springer, vol. 77(1), pages 95-125, March.
    16. Mazen Bouchur & Andreas Reinhardt, 2025. "Synergistic Non-Intrusive Load Monitoring: Dual-Model Training and Inference for Improved Load Disaggregation Prediction," Energies, MDPI, vol. 18(3), pages 1-15, January.
    17. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    18. Papageorgiou, Petros G. & Christoforidis, Georgios C. & Bouhouras, Aggelos S., 2025. "NILM in high frequency domain: A critical review on recent trends and practical challenges," Renewable and Sustainable Energy Reviews, Elsevier, vol. 213(C).
    19. Andrea Mariscotti, 2022. "Non-Intrusive Load Monitoring Applied to AC Railways," Energies, MDPI, vol. 15(11), pages 1-27, June.
    20. Sarra Houidi & Dominique Fourer & François Auger & Houda Ben Attia Sethom & Laurence Miègeville, 2021. "Comparative Evaluation of Non-Intrusive Load Monitoring Methods Using Relevant Features and Transfer Learning," Energies, MDPI, vol. 14(9), pages 1-28, May.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:10:p:2464-:d:1653422. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.