IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v313y2022ics0306261922002483.html
   My bibliography  Save this article

Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism

Author

Listed:
  • Niu, Dongxiao
  • Yu, Min
  • Sun, Lijie
  • Gao, Tian
  • Wang, Keke

Abstract

Accurate short-term multi-energy load forecasting is an essential prerequisite for ensuring the reliable and economic operation of integrated energy systems (IES). Considering the large fluctuations, strong randomness, and the multi-energy coupling relationship of regional IES, this paper proposes a novel short-term multi-energy load forecasting method based on a CNN-BiGRU model that is optimized by attention mechanism. First, the dynamic coupling relationship between multi-energy loads is qualitatively analyzed, and the influencing factors of multi-energ loads are screened based on data-driven analysis. Second, a one-dimensional CNN layer is formulated to extract complex high-dimensional features, and BiGRU is constructed to extract the time dependence from historical sequences. In particular, three attention mechanism modules are introduced to the BiGRU hidden state through the mapping weight and learning parameter matrix to enhance the impact of key information. Then, hard weight sharing is adopted to extract the inherent multi-energy coupling relationship. Finally, a novel multi-task loss function weight optimization method is applied to search for the optimal multi-task weight, which is used to balance multi-task learning (MTL) to achieve the optimization of the overall forecasting model. To validate the effectiveness of the CNN-BiGRU-Attention MTL model with loss function optimization, this paper compares the proposed model with five benchmark models by MAPE, RMSE, MAE, R2, and computational time. Compared with the traditional LSTM model, the cooling, heat, and electrical load forecasting accuracy (measured by MAPE) of the proposed hybrid model increased by 61.86%, 73.03%, and 63.39%, respectively, which demonstrates that the proposed model exhibits superior performance.

Suggested Citation

  • Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
  • Handle: RePEc:eee:appene:v:313:y:2022:i:c:s0306261922002483
    DOI: 10.1016/j.apenergy.2022.118801
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261922002483
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2022.118801?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Yongli & Wang, Yudong & Huang, Yujing & Li, Fang & Zeng, Ming & Li, Jiapu & Wang, Xiaohai & Zhang, Fuwei, 2019. "Planning and operation method of the regional integrated energy system considering economy and environment," Energy, Elsevier, vol. 171(C), pages 731-750.
    2. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    3. Qadrdan, Meysam & Chaudry, Modassar & Wu, Jianzhong & Jenkins, Nick & Ekanayake, Janaka, 2010. "Impact of a large penetration of wind generation on the GB gas network," Energy Policy, Elsevier, vol. 38(10), pages 5684-5695, October.
    4. Guo, Zhifeng & Zhou, Kaile & Zhang, Xiaoling & Yang, Shanlin, 2018. "A deep learning model for short-term power load and probability density forecasting," Energy, Elsevier, vol. 160(C), pages 1186-1200.
    5. Jebli, Imane & Belouadha, Fatima-Zahra & Kabbaj, Mohammed Issam & Tilioua, Amine, 2021. "Prediction of solar energy guided by pearson correlation using machine learning," Energy, Elsevier, vol. 224(C).
    6. Huang, Qian & Li, Jinghua & Zhu, Mengshu, 2020. "An improved convolutional neural network with load range discretization for probabilistic load forecasting," Energy, Elsevier, vol. 203(C).
    7. Wang, Shaomin & Wang, Shouxiang & Chen, Haiwen & Gu, Qiang, 2020. "Multi-energy load forecasting for regional integrated energy systems considering temporal dynamic and coupling characteristics," Energy, Elsevier, vol. 195(C).
    8. Aqdas Naz & Nadeem Javaid & Muhammad Babar Rasheed & Abdul Haseeb & Musaed Alhussein & Khursheed Aurangzeb, 2019. "Game Theoretical Energy Management with Storage Capacity Optimization and Photo-Voltaic Cell Generated Power Forecasting in Micro Grid," Sustainability, MDPI, vol. 11(10), pages 1-22, May.
    9. Ömer Özgür Bozkurt & Göksel Biricik & Ziya Cihan Tayşi, 2017. "Artificial neural network and SARIMA based models for power load forecasting in Turkish electricity market," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-24, April.
    10. Spoladore, Alessandro & Borelli, Davide & Devia, Francesco & Mora, Flavio & Schenone, Corrado, 2016. "Model for forecasting residential heat demand based on natural gas consumption and energy performance indicators," Applied Energy, Elsevier, vol. 182(C), pages 488-499.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zheng Wan & Hui Li, 2023. "Short-Term Power Load Forecasting Based on Feature Filtering and Error Compensation under Imbalanced Samples," Energies, MDPI, vol. 16(10), pages 1-22, May.
    2. Zhou, Guangzhao & Guo, Zanquan & Sun, Simin & Jin, Qingsheng, 2023. "A CNN-BiGRU-AM neural network for AI applications in shale oil production prediction," Applied Energy, Elsevier, vol. 344(C).
    3. Max Olinto Moreira & Betania Mafra Kaizer & Takaaki Ohishi & Benedito Donizeti Bonatto & Antonio Carlos Zambroni de Souza & Pedro Paulo Balestrassi, 2022. "Multivariate Strategy Using Artificial Neural Networks for Seasonal Photovoltaic Generation Forecasting," Energies, MDPI, vol. 16(1), pages 1-30, December.
    4. Meng, Anbo & Xie, Zhifeng & Luo, Jianqiang & Zeng, Ying & Xu, Xuancong & Li, Yidian & Wu, Zhenbo & Zhang, Zhan & Zhu, Jianbin & Xian, Zikang & Li, Chen & Yan, Baiping & Yin, Hao, 2023. "An adaptive variational mode decomposition for wind power prediction using convolutional block attention deep learning network," Energy, Elsevier, vol. 282(C).
    5. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    6. Zhao, Geya & Xue, Minggao & Cheng, Li, 2023. "A new hybrid model for multi-step WTI futures price forecasting based on self-attention mechanism and spatial–temporal graph neural network," Resources Policy, Elsevier, vol. 85(PB).
    7. Zhao, Hongqian & Chen, Zheng & Shu, Xing & Shen, Jiangwei & Lei, Zhenzhen & Zhang, Yuanjian, 2023. "State of health estimation for lithium-ion batteries based on hybrid attention and deep learning," Reliability Engineering and System Safety, Elsevier, vol. 232(C).
    8. Suqi Zhang & Ningjing Zhang & Ziqi Zhang & Ying Chen, 2022. "Electric Power Load Forecasting Method Based on a Support Vector Machine Optimized by the Improved Seagull Optimization Algorithm," Energies, MDPI, vol. 15(23), pages 1-17, December.
    9. Yuvaraj Natarajan & Sri Preethaa K. R. & Gitanjali Wadhwa & Young Choi & Zengshun Chen & Dong-Eun Lee & Yirong Mi, 2024. "Enhancing Building Energy Efficiency with IoT-Driven Hybrid Deep Learning Models for Accurate Energy Consumption Prediction," Sustainability, MDPI, vol. 16(5), pages 1-23, February.
    10. Du, Yi & Cui, Naxin & Cui, Wei & Li, Tao & Ren, Fei & Zhang, Chenghui, 2023. "AGRU and convex optimization based energy management for plug-in hybrid electric bus considering battery aging," Energy, Elsevier, vol. 277(C).
    11. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Yan, Yichuan & Tian, Ning, 2023. "Prediction of fluctuation loads based on GARCH family-CatBoost-CNNLSTM," Energy, Elsevier, vol. 263(PE).
    12. Jiang, Yuqi & Gao, Tianlu & Dai, Yuxin & Si, Ruiqi & Hao, Jun & Zhang, Jun & Gao, David Wenzhong, 2022. "Very short-term residential load forecasting based on deep-autoformer," Applied Energy, Elsevier, vol. 328(C).
    13. Tzu-Chia Chen & José Ricardo Nuñez Alvarez & Ngakan Ketut Acwin Dwijendra & Zainab Jawad Kadhim & Reza Alayi & Ravinder Kumar & Seepana PraveenKumar & Vladimir Ivanovich Velkin, 2023. "Modeling and Optimization of Combined Heating, Power, and Gas Production System Based on Renewable Energies," Sustainability, MDPI, vol. 15(10), pages 1-16, May.
    14. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    15. Yu, Min & Niu, Dongxiao & Zhao, Jinqiu & Li, Mingyu & Sun, Lijie & Yu, Xiaoyu, 2023. "Building cooling load forecasting of IES considering spatiotemporal coupling based on hybrid deep learning model," Applied Energy, Elsevier, vol. 349(C).
    16. Mahdi Khodayar & Jacob Regan, 2023. "Deep Neural Networks in Power Systems: A Review," Energies, MDPI, vol. 16(12), pages 1-38, June.
    17. Yifei Chen & Zhihan Fu, 2023. "Multi-Step Ahead Forecasting of the Energy Consumed by the Residential and Commercial Sectors in the United States Based on a Hybrid CNN-BiLSTM Model," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    18. Liu, Liqi & Liu, Yanli, 2022. "Load image inpainting: An improved U-Net based load missing data recovery method," Applied Energy, Elsevier, vol. 327(C).
    19. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    2. Zheng, Ling & Zhou, Bin & Cao, Yijia & Wing Or, Siu & Li, Yong & Wing Chan, Ka, 2022. "Hierarchical distributed multi-energy demand response for coordinated operation of building clusters," Applied Energy, Elsevier, vol. 308(C).
    3. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    4. Lu, Zhiming & Gao, Yan & Xu, Chuanbo, 2021. "Evaluation of energy management system for regional integrated energy system under interval type-2 hesitant fuzzy environment," Energy, Elsevier, vol. 222(C).
    5. Lu, Shixiang & Xu, Qifa & Jiang, Cuixia & Liu, Yezheng & Kusiak, Andrew, 2022. "Probabilistic load forecasting with a non-crossing sparse-group Lasso-quantile regression deep neural network," Energy, Elsevier, vol. 242(C).
    6. Wang, Jingfan & Tchapmi, Lyne P. & Ravikumar, Arvind P. & McGuire, Mike & Bell, Clay S. & Zimmerle, Daniel & Savarese, Silvio & Brandt, Adam R., 2020. "Machine vision for natural gas methane emissions detection using an infrared camera," Applied Energy, Elsevier, vol. 257(C).
    7. Zhou, Guangzhao & Guo, Zanquan & Sun, Simin & Jin, Qingsheng, 2023. "A CNN-BiGRU-AM neural network for AI applications in shale oil production prediction," Applied Energy, Elsevier, vol. 344(C).
    8. Mayer, Martin János & Biró, Bence & Szücs, Botond & Aszódi, Attila, 2023. "Probabilistic modeling of future electricity systems with high renewable energy penetration using machine learning," Applied Energy, Elsevier, vol. 336(C).
    9. Qian, Fanyue & Gao, Weijun & Yang, Yongwen & Yu, Dan, 2020. "Potential analysis of the transfer learning model in short and medium-term forecasting of building HVAC energy consumption," Energy, Elsevier, vol. 193(C).
    10. Jason Runge & Radu Zmeureanu, 2021. "A Review of Deep Learning Techniques for Forecasting Energy Use in Buildings," Energies, MDPI, vol. 14(3), pages 1-26, January.
    11. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    12. Hwang, Jun Kwon & Yun, Geun Young & Lee, Sukho & Seo, Hyeongjoon & Santamouris, Mat, 2020. "Using deep learning approaches with variable selection process to predict the energy performance of a heating and cooling system," Renewable Energy, Elsevier, vol. 149(C), pages 1227-1245.
    13. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    14. Deb, Chirag & Dai, Zhonghao & Schlueter, Arno, 2021. "A machine learning-based framework for cost-optimal building retrofit," Applied Energy, Elsevier, vol. 294(C).
    15. Seok-Jun Bu & Sung-Bae Cho, 2020. "Time Series Forecasting with Multi-Headed Attention-Based Deep Learning for Residential Energy Consumption," Energies, MDPI, vol. 13(18), pages 1-16, September.
    16. Hafeez, Ghulam & Alimgeer, Khurram Saleem & Khan, Imran, 2020. "Electric load forecasting based on deep learning and optimized by heuristic algorithm in smart grid," Applied Energy, Elsevier, vol. 269(C).
    17. Wang, Yongli & Ma, Yuze & Song, Fuhao & Ma, Yang & Qi, Chengyuan & Huang, Feifei & Xing, Juntai & Zhang, Fuwei, 2020. "Economic and efficient multi-objective operation optimization of integrated energy system considering electro-thermal demand response," Energy, Elsevier, vol. 205(C).
    18. Haoran Zhao & Sen Guo, 2021. "Uncertain Interval Forecasting for Combined Electricity-Heat-Cooling-Gas Loads in the Integrated Energy System Based on Multi-Task Learning and Multi-Kernel Extreme Learning Machine," Mathematics, MDPI, vol. 9(14), pages 1-32, July.
    19. Wang, Yongli & Wang, Yudong & Huang, Yujing & Yang, Jiale & Ma, Yuze & Yu, Haiyang & Zeng, Ming & Zhang, Fuwei & Zhang, Yanfu, 2019. "Operation optimization of regional integrated energy system based on the modeling of electricity-thermal-natural gas network," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    20. Wen Fan & Qing Liu & Mingyu Wang, 2021. "Bi-Level Multi-Objective Optimization Scheduling for Regional Integrated Energy Systems Based on Quantum Evolutionary Algorithm," Energies, MDPI, vol. 14(16), pages 1-15, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:313:y:2022:i:c:s0306261922002483. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.