IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i8p3446-d1123574.html
   My bibliography  Save this article

Pre-Attention Mechanism and Convolutional Neural Network Based Multivariate Load Prediction for Demand Response

Author

Listed:
  • Zheyu He

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Rongheng Lin

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Budan Wu

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Xin Zhao

    (Economic & Research Institute, State Grid Shandong Electric Power Company, Jinan 250021, China)

  • Hua Zou

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

Abstract

The construction of smart grids has greatly changed the power grid pattern and power supply structure. For the power system, reasonable power planning and demand response is necessary to ensure the stable operation of a society. Accurate load prediction is the basis for realizing demand response for the power system. This paper proposes a Pre-Attention-CNN-GRU model (PreAttCG) which combines a convolutional neural network (CNN) and gate recurrent unit (GRU) and applies the attention mechanism in front of the whole model. The PreAttCG model accepts historical load data and more than nine other factors (including temperature, wind speed, humidity, etc.) as input. The attention layer and CNN layer effectively extract the features and weights of each factor. Load forecasting is then performed by the prediction layer, which consists of a stacked GRU. The model is verified by industrial load data from a German dataset and a Chinese dataset from the real world. The results show that the PreAttCG model has better performance (3~5% improvement in MAPE) than both LSTM with only load input and LSTM with all factors. Additionally, the experiments also show that the attention mechanism can effectively extract the weights of relevant factors affecting the load data.

Suggested Citation

  • Zheyu He & Rongheng Lin & Budan Wu & Xin Zhao & Hua Zou, 2023. "Pre-Attention Mechanism and Convolutional Neural Network Based Multivariate Load Prediction for Demand Response," Energies, MDPI, vol. 16(8), pages 1-13, April.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:8:p:3446-:d:1123574
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/8/3446/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/8/3446/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fan, Cheng & Xiao, Fu & Zhao, Yang, 2017. "A short-term building cooling load prediction method using deep learning algorithms," Applied Energy, Elsevier, vol. 195(C), pages 222-233.
    2. Hany Habbak & Mohamed Mahmoud & Khaled Metwally & Mostafa M. Fouda & Mohamed I. Ibrahem, 2023. "Load Forecasting Techniques and Their Applications in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    3. Huang, Yanmei & Hasan, Najmul & Deng, Changrui & Bao, Yukun, 2022. "Multivariate empirical mode decomposition based hybrid model for day-ahead peak load forecasting," Energy, Elsevier, vol. 239(PC).
    4. Zhang, Wenyu & Chen, Qian & Yan, Jianyong & Zhang, Shuai & Xu, Jiyuan, 2021. "A novel asynchronous deep reinforcement learning model with adaptive early forecasting method and reward incentive mechanism for short-term load forecasting," Energy, Elsevier, vol. 236(C).
    5. Xing, Yazhou & Zhang, Su & Wen, Peng & Shao, Limin & Rouyendegh, Babak Daneshvar, 2020. "Load prediction in short-term implementing the multivariate quantile regression," Energy, Elsevier, vol. 196(C).
    6. Zhang, Guoqiang & Guo, Jifeng, 2020. "A novel ensemble method for residential electricity demand forecasting based on a novel sample simulation strategy," Energy, Elsevier, vol. 207(C).
    7. Imani, Maryam, 2021. "Electrical load-temperature CNN for residential load forecasting," Energy, Elsevier, vol. 227(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hesen Zuo & Wengang Zheng & Mingfei Wang & Xin Zhang, 2023. "Prediction of Heat and Cold Loads of Factory Mushroom Houses Based on EWT Decomposition," Sustainability, MDPI, vol. 15(21), pages 1-19, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiakang Wang & Hui Liu & Guangji Zheng & Ye Li & Shi Yin, 2023. "Short-Term Load Forecasting Based on Outlier Correction, Decomposition, and Ensemble Reinforcement Learning," Energies, MDPI, vol. 16(11), pages 1-16, May.
    2. Eren, Yavuz & Küçükdemiral, İbrahim, 2024. "A comprehensive review on deep learning approaches for short-term load forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    3. Mingping Liu & Xihao Sun & Qingnian Wang & Suhui Deng, 2022. "Short-Term Load Forecasting Using EMD with Feature Selection and TCN-Based Deep Learning Model," Energies, MDPI, vol. 15(19), pages 1-22, September.
    4. Shi, Jiaqi & Li, Chenxi & Yan, Xiaohe, 2023. "Artificial intelligence for load forecasting: A stacking learning approach based on ensemble diversity regularization," Energy, Elsevier, vol. 262(PB).
    5. Umme Mumtahina & Sanath Alahakoon & Peter Wolfs, 2024. "Hyperparameter Tuning of Load-Forecasting Models Using Metaheuristic Optimization Algorithms—A Systematic Review," Mathematics, MDPI, vol. 12(21), pages 1-51, October.
    6. Huang, Yanmei & Hasan, Najmul & Deng, Changrui & Bao, Yukun, 2022. "Multivariate empirical mode decomposition based hybrid model for day-ahead peak load forecasting," Energy, Elsevier, vol. 239(PC).
    7. Rui Luo & Jinpei Liu & Piao Wang & Zhifu Tao & Huayou Chen, 2024. "A multisource data‐driven combined forecasting model based on internet search keyword screening method for interval soybean futures price," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(2), pages 366-390, March.
    8. World Bank Group, 2024. "Poland Country Climate and Development Report," World Bank Publications - Reports 42286, The World Bank Group.
    9. Alfredo Candela Esclapez & Miguel López García & Sergio Valero Verdú & Carolina Senabre Blanes, 2022. "Automatic Selection of Temperature Variables for Short-Term Load Forecasting," Sustainability, MDPI, vol. 14(20), pages 1-22, October.
    10. Sanja Stevanović & Husain Dashti & Marko Milošević & Salem Al-Yakoob & Dragan Stevanović, 2024. "Comparison of ANN and XGBoost surrogate models trained on small numbers of building energy simulations," PLOS ONE, Public Library of Science, vol. 19(10), pages 1-22, October.
    11. Gautham Krishnadas & Aristides Kiprakis, 2020. "A Machine Learning Pipeline for Demand Response Capacity Scheduling," Energies, MDPI, vol. 13(7), pages 1-25, April.
    12. Jessica Walther & Matthias Weigold, 2021. "A Systematic Review on Predicting and Forecasting the Electrical Energy Consumption in the Manufacturing Industry," Energies, MDPI, vol. 14(4), pages 1-24, February.
    13. Wei, Ziqing & Zhang, Tingwei & Yue, Bao & Ding, Yunxiao & Xiao, Ran & Wang, Ruzhu & Zhai, Xiaoqiang, 2021. "Prediction of residential district heating load based on machine learning: A case study," Energy, Elsevier, vol. 231(C).
    14. Stefano Villa & Claudio Sassanelli, 2020. "The Data-Driven Multi-Step Approach for Dynamic Estimation of Buildings’ Interior Temperature," Energies, MDPI, vol. 13(24), pages 1-23, December.
    15. Wang, Lei & Wang, Xinyu & Zhao, Zhongchao, 2024. "Mid-term electricity demand forecasting using improved multi-mode reconstruction and particle swarm-enhanced support vector regression," Energy, Elsevier, vol. 304(C).
    16. Ling, Jihong & Zhang, Bingyang & Dai, Na & Xing, Jincheng, 2023. "Coupling input feature construction methods and machine learning algorithms for hourly secondary supply temperature prediction," Energy, Elsevier, vol. 278(C).
    17. Wang, Ran & Lu, Shilei & Feng, Wei, 2020. "A novel improved model for building energy consumption prediction based on model integration," Applied Energy, Elsevier, vol. 262(C).
    18. Héctor Chávez & Yuri Molina, 2025. "Geospatial Forecasting of Electric Energy in Distribution Systems Using Segmentation and Machine Learning with Convolutional Methods," Energies, MDPI, vol. 18(2), pages 1-28, January.
    19. Tang, Zihan & Ji, Tianyao & Kang, Jiaxi & Huang, Yunlin & Tang, Wenhu, 2025. "Learning global and local features of power load series through transformer and 2D-CNN: An image-based multi-step forecasting approach incorporating phase space reconstruction," Applied Energy, Elsevier, vol. 378(PA).
    20. Li, Sihui & Gong, Guangcai & Peng, Jinqing, 2019. "Dynamic coupling method between air-source heat pumps and buildings in China’s hot-summer/cold-winter zone," Applied Energy, Elsevier, vol. 254(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:8:p:3446-:d:1123574. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.