IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v282y2023ics0360544223016687.html

Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism

Author

Listed:
  • Wan, Anping
  • Chang, Qing
  • AL-Bukhaiti, Khalil
  • He, Jiabo

Abstract

This study proposes a new approach for short-term power load forecasting using a combination of convolutional neural networks (CNN), long short-term memory (LSTM), and attention mechanisms to address the issue of information loss due to excessively long input time series data. The objective is to enhance the accuracy of short-term power load prediction, which is crucial for efficient energy management. The study analyzes the relationship between the target load and the collected parameters, identifying the most influential factors using Pearson correlation coefficient analysis. A one-dimensional CNN layer is utilized to extract high-dimensional features from the input data, followed by an LSTM layer that captures temporal correlations within the historical sequences. Finally, an attention mechanism is introduced to optimize the weight of the LSTM output, enhance the influence of key information, and optimize the overall prediction model. The performance of the proposed model is evaluated using two benchmark models based on mean absolute percentage error (MAPE), root mean square error (RMSE), and mean absolute error (MAE) metrics. The results show that the CNN-LSTM-A model outperforms the traditional LSTM model regarding power load prediction accuracy for two thermal power units, with an improvement of 7.3% and 5.7%, respectively, indicating superior performance. Therefore, this study demonstrates the effectiveness of the proposed CNN-LSTM-A model for short-term power load forecasting, which has potential applications in the energy industry. In conclusion, the proposed approach can improve the accuracy of power load forecasting, leading to more efficient energy management and cost savings. Additionally, the study highlights the importance of incorporating attention mechanisms into traditional LSTM models for power load forecasting, as it helps to optimize the weight of the LSTM output and improve the accuracy of the predictions. The proposed CNN-LSTM-A model can be potentially useful for energy companies and policymakers in making informed decisions regarding energy production and consumption. Overall, this study provides a valuable contribution to power load forecasting, and the proposed approach could be extended to other areas of time-series forecasting in the future.

Suggested Citation

  • Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
  • Handle: RePEc:eee:energy:v:282:y:2023:i:c:s0360544223016687
    DOI: 10.1016/j.energy.2023.128274
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223016687
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2023.128274?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Lizhen Wu & Chun Kong & Xiaohong Hao & Wei Chen, 2020. "A Short-Term Load Forecasting Method Based on GRU-CNN Hybrid Neural Network Model," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-10, March.
    2. Wang, Yongli & Wang, Yudong & Huang, Yujing & Li, Fang & Zeng, Ming & Li, Jiapu & Wang, Xiaohai & Zhang, Fuwei, 2019. "Planning and operation method of the regional integrated energy system considering economy and environment," Energy, Elsevier, vol. 171(C), pages 731-750.
    3. Huang, Qian & Li, Jinghua & Zhu, Mengshu, 2020. "An improved convolutional neural network with load range discretization for probabilistic load forecasting," Energy, Elsevier, vol. 203(C).
    4. Aqdas Naz & Nadeem Javaid & Muhammad Babar Rasheed & Abdul Haseeb & Musaed Alhussein & Khursheed Aurangzeb, 2019. "Game Theoretical Energy Management with Storage Capacity Optimization and Photo-Voltaic Cell Generated Power Forecasting in Micro Grid," Sustainability, MDPI, vol. 11(10), pages 1-22, May.
    5. Anping Wan & Qing Chang & Yinlong Zhang & Chao Wei & Reuben Seyram Komla Agbozo & Xiaoliang Zhao, 2022. "Optimal Load Distribution of CHP Based on Combined Deep Learning and Genetic Algorithm," Energies, MDPI, vol. 15(20), pages 1-19, October.
    6. Jebli, Imane & Belouadha, Fatima-Zahra & Kabbaj, Mohammed Issam & Tilioua, Amine, 2021. "Prediction of solar energy guided by pearson correlation using machine learning," Energy, Elsevier, vol. 224(C).
    7. Spoladore, Alessandro & Borelli, Davide & Devia, Francesco & Mora, Flavio & Schenone, Corrado, 2016. "Model for forecasting residential heat demand based on natural gas consumption and energy performance indicators," Applied Energy, Elsevier, vol. 182(C), pages 488-499.
    8. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    9. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    2. Duan, Pengfei & Zhao, Xiaoyu & Hu, Jinxue & Li, Kang & Xue, Qingwen & Cao, Xiaodong & Wang, Yanmin & Zhao, Bingxu & Zhang, Chenyang & Yuan, Xiaoyang, 2026. "Multi-energy load forecasting incorporating AI algorithms: research status and trends in integrated energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 229(C).
    3. Fargalla, Mandella Ali M. & Yan, Wei & Deng, Jingen & Wu, Tao & Kiyingi, Wyclif & Li, Guangcong & Zhang, Wei, 2024. "TimeNet: Time2Vec attention-based CNN-BiGRU neural network for predicting production in shale and sandstone gas reservoirs," Energy, Elsevier, vol. 290(C).
    4. Qizhuan Shao & Rungang Bao & Shuangquan Liu & Kaixiang Fu & Li Mo & Wenjing Xiao, 2025. "Short-Term Electric Load Probability Forecasting Based on the BiGRU-GAM-GPR Model," Sustainability, MDPI, vol. 17(12), pages 1-23, June.
    5. Wang, Lining & Mao, Mingxuan & Xie, Jili & Liao, Zheng & Zhang, Hao & Li, Huanxin, 2023. "Accurate solar PV power prediction interval method based on frequency-domain decomposition and LSTM model," Energy, Elsevier, vol. 262(PB).
    6. Yin, Linfei & Wang, Nannan & Li, Jishen, 2025. "Electricity terminal multi-label recognition with a “one-versus-all” rejection recognition algorithm based on adaptive distillation increment learning and attention MobileNetV2 network for non-invasive load monitoring," Applied Energy, Elsevier, vol. 382(C).
    7. Li, Ke & Qin, Zheng & Mu, Yuchen & Wang, Haiyang & Bie, Qingfeng & Yin, Xianxin & Yan, Yi, 2025. "Transfer learning-based multi-energy load forecasting method for integrated energy system with zero-shot," Applied Energy, Elsevier, vol. 401(PC).
    8. Zhao, Hongqian & Chen, Zheng & Shu, Xing & Shen, Jiangwei & Lei, Zhenzhen & Zhang, Yuanjian, 2023. "State of health estimation for lithium-ion batteries based on hybrid attention and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    9. Li, Huanhuan & Zhang, Yu & Li, Yan & Lam, Jasmine Siu Lee & Matthews, Christian & Yang, Zaili, 2025. "Deep multi-view information-powered vessel traffic flow prediction for intelligent transportation management," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 197(C).
    10. Zhou, Guangzhao & Guo, Zanquan & Sun, Simin & Jin, Qingsheng, 2023. "A CNN-BiGRU-AM neural network for AI applications in shale oil production prediction," Applied Energy, Elsevier, vol. 344(C).
    11. Li, Ke & Mu, Yuchen & Yang, Fan & Wang, Haiyang & Yan, Yi & Zhang, Chenghui, 2024. "Joint forecasting of source-load-price for integrated energy system based on multi-task learning and hybrid attention mechanism," Applied Energy, Elsevier, vol. 360(C).
    12. Zhu, Junda & Yang, Junhong & Peng, Mengbo & Liang, Xinyue & Ben, Chaoran, 2025. "Deep learning-driven heat load prediction: Investigating the impacts of optimizer and learning rate scheduler strategies," Energy, Elsevier, vol. 340(C).
    13. Song, Cairong & Yang, Haidong & Cai, Jianyang & Yang, Pan & Bao, Hao & Xu, Kangkang & Meng, Xian-Bing, 2024. "Multi-energy load forecasting via hierarchical multi-task learning and spatiotemporal attention," Applied Energy, Elsevier, vol. 373(C).
    14. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    15. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    16. Tian, Zhirui & Liu, Weican & Jiang, Wenqian & Wu, Chenye, 2024. "CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability," Energy, Elsevier, vol. 293(C).
    17. Kim, Hyung Joon & Kim, Dongwoo & Tak, Hyunwoo & Lee, Jae Yong, 2025. "Global-local attention-enabled multiple decoder Transformer for multi-energy load forecasting in user-level integrated energy system," Applied Energy, Elsevier, vol. 396(C).
    18. Xuemeng Zhao & Weilun Huang, 2024. "Global Geopolitical Changes and New/Renewable Energy Game," Energies, MDPI, vol. 17(16), pages 1-27, August.
    19. Sheng Huang & Huakun Que & Lukun Zeng & Jingxu Yang & Kaihong Zheng, 2024. "Multi-Scale Graph Attention Network Based on Encoding Decomposition for Electricity Consumption Prediction," Energies, MDPI, vol. 17(23), pages 1-18, November.
    20. Huiling Li & Cong Liu & Qinjun Du & Qingtian Zeng & Jinglin Zhang & Georgios Theodoropoulo & Long Cheng, 2025. "Sampling-Based Next-Event Prediction for Wind-Turbine Maintenance Processes," Energies, MDPI, vol. 18(16), pages 1-17, August.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:282:y:2023:i:c:s0360544223016687. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.