IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i8p3446-d1123574.html
   My bibliography  Save this article

Pre-Attention Mechanism and Convolutional Neural Network Based Multivariate Load Prediction for Demand Response

Author

Listed:
  • Zheyu He

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Rongheng Lin

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Budan Wu

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

  • Xin Zhao

    (Economic & Research Institute, State Grid Shandong Electric Power Company, Jinan 250021, China)

  • Hua Zou

    (State Key Laboratory of Networking and Switching Technology, School of Computer Science (National Pilot Software Engineering School), Beijing University of Posts and Telecommunications, Beijing 100876, China)

Abstract

The construction of smart grids has greatly changed the power grid pattern and power supply structure. For the power system, reasonable power planning and demand response is necessary to ensure the stable operation of a society. Accurate load prediction is the basis for realizing demand response for the power system. This paper proposes a Pre-Attention-CNN-GRU model (PreAttCG) which combines a convolutional neural network (CNN) and gate recurrent unit (GRU) and applies the attention mechanism in front of the whole model. The PreAttCG model accepts historical load data and more than nine other factors (including temperature, wind speed, humidity, etc.) as input. The attention layer and CNN layer effectively extract the features and weights of each factor. Load forecasting is then performed by the prediction layer, which consists of a stacked GRU. The model is verified by industrial load data from a German dataset and a Chinese dataset from the real world. The results show that the PreAttCG model has better performance (3~5% improvement in MAPE) than both LSTM with only load input and LSTM with all factors. Additionally, the experiments also show that the attention mechanism can effectively extract the weights of relevant factors affecting the load data.

Suggested Citation

  • Zheyu He & Rongheng Lin & Budan Wu & Xin Zhao & Hua Zou, 2023. "Pre-Attention Mechanism and Convolutional Neural Network Based Multivariate Load Prediction for Demand Response," Energies, MDPI, vol. 16(8), pages 1-13, April.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:8:p:3446-:d:1123574
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/8/3446/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/8/3446/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Fan, Cheng & Xiao, Fu & Zhao, Yang, 2017. "A short-term building cooling load prediction method using deep learning algorithms," Applied Energy, Elsevier, vol. 195(C), pages 222-233.
    2. Zhang, Wenyu & Chen, Qian & Yan, Jianyong & Zhang, Shuai & Xu, Jiyuan, 2021. "A novel asynchronous deep reinforcement learning model with adaptive early forecasting method and reward incentive mechanism for short-term load forecasting," Energy, Elsevier, vol. 236(C).
    3. Imani, Maryam, 2021. "Electrical load-temperature CNN for residential load forecasting," Energy, Elsevier, vol. 227(C).
    4. Hany Habbak & Mohamed Mahmoud & Khaled Metwally & Mostafa M. Fouda & Mohamed I. Ibrahem, 2023. "Load Forecasting Techniques and Their Applications in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    5. Huang, Yanmei & Hasan, Najmul & Deng, Changrui & Bao, Yukun, 2022. "Multivariate empirical mode decomposition based hybrid model for day-ahead peak load forecasting," Energy, Elsevier, vol. 239(PC).
    6. Xing, Yazhou & Zhang, Su & Wen, Peng & Shao, Limin & Rouyendegh, Babak Daneshvar, 2020. "Load prediction in short-term implementing the multivariate quantile regression," Energy, Elsevier, vol. 196(C).
    7. Zhang, Guoqiang & Guo, Jifeng, 2020. "A novel ensemble method for residential electricity demand forecasting based on a novel sample simulation strategy," Energy, Elsevier, vol. 207(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hesen Zuo & Wengang Zheng & Mingfei Wang & Xin Zhang, 2023. "Prediction of Heat and Cold Loads of Factory Mushroom Houses Based on EWT Decomposition," Sustainability, MDPI, vol. 15(21), pages 1-19, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jiakang Wang & Hui Liu & Guangji Zheng & Ye Li & Shi Yin, 2023. "Short-Term Load Forecasting Based on Outlier Correction, Decomposition, and Ensemble Reinforcement Learning," Energies, MDPI, vol. 16(11), pages 1-16, May.
    2. Mingping Liu & Xihao Sun & Qingnian Wang & Suhui Deng, 2022. "Short-Term Load Forecasting Using EMD with Feature Selection and TCN-Based Deep Learning Model," Energies, MDPI, vol. 15(19), pages 1-22, September.
    3. Shi, Jiaqi & Li, Chenxi & Yan, Xiaohe, 2023. "Artificial intelligence for load forecasting: A stacking learning approach based on ensemble diversity regularization," Energy, Elsevier, vol. 262(PB).
    4. Huang, Yanmei & Hasan, Najmul & Deng, Changrui & Bao, Yukun, 2022. "Multivariate empirical mode decomposition based hybrid model for day-ahead peak load forecasting," Energy, Elsevier, vol. 239(PC).
    5. Alfredo Candela Esclapez & Miguel López García & Sergio Valero Verdú & Carolina Senabre Blanes, 2022. "Automatic Selection of Temperature Variables for Short-Term Load Forecasting," Sustainability, MDPI, vol. 14(20), pages 1-22, October.
    6. Gautham Krishnadas & Aristides Kiprakis, 2020. "A Machine Learning Pipeline for Demand Response Capacity Scheduling," Energies, MDPI, vol. 13(7), pages 1-25, April.
    7. Jessica Walther & Matthias Weigold, 2021. "A Systematic Review on Predicting and Forecasting the Electrical Energy Consumption in the Manufacturing Industry," Energies, MDPI, vol. 14(4), pages 1-24, February.
    8. Wei, Ziqing & Zhang, Tingwei & Yue, Bao & Ding, Yunxiao & Xiao, Ran & Wang, Ruzhu & Zhai, Xiaoqiang, 2021. "Prediction of residential district heating load based on machine learning: A case study," Energy, Elsevier, vol. 231(C).
    9. Stefano Villa & Claudio Sassanelli, 2020. "The Data-Driven Multi-Step Approach for Dynamic Estimation of Buildings’ Interior Temperature," Energies, MDPI, vol. 13(24), pages 1-23, December.
    10. Ling, Jihong & Zhang, Bingyang & Dai, Na & Xing, Jincheng, 2023. "Coupling input feature construction methods and machine learning algorithms for hourly secondary supply temperature prediction," Energy, Elsevier, vol. 278(C).
    11. Wang, Ran & Lu, Shilei & Feng, Wei, 2020. "A novel improved model for building energy consumption prediction based on model integration," Applied Energy, Elsevier, vol. 262(C).
    12. Li, Sihui & Gong, Guangcai & Peng, Jinqing, 2019. "Dynamic coupling method between air-source heat pumps and buildings in China’s hot-summer/cold-winter zone," Applied Energy, Elsevier, vol. 254(C).
    13. Lu, Shixiang & Xu, Qifa & Jiang, Cuixia & Liu, Yezheng & Kusiak, Andrew, 2022. "Probabilistic load forecasting with a non-crossing sparse-group Lasso-quantile regression deep neural network," Energy, Elsevier, vol. 242(C).
    14. Manoj Manivannan & Behzad Najafi & Fabio Rinaldi, 2017. "Machine Learning-Based Short-Term Prediction of Air-Conditioning Load through Smart Meter Analytics," Energies, MDPI, vol. 10(11), pages 1-17, November.
    15. Amasyali, Kadir & El-Gohary, Nora M., 2021. "Real data-driven occupant-behavior optimization for reduced energy consumption and improved comfort," Applied Energy, Elsevier, vol. 302(C).
    16. Li, Ao & Xiao, Fu & Zhang, Chong & Fan, Cheng, 2021. "Attention-based interpretable neural network for building cooling load prediction," Applied Energy, Elsevier, vol. 299(C).
    17. Afroz, Zakia & Urmee, Tania & Shafiullah, G.M. & Higgins, Gary, 2018. "Real-time prediction model for indoor temperature in a commercial building," Applied Energy, Elsevier, vol. 231(C), pages 29-53.
    18. Chitalia, Gopal & Pipattanasomporn, Manisa & Garg, Vishal & Rahman, Saifur, 2020. "Robust short-term electrical load forecasting framework for commercial buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 278(C).
    19. Danxiang Wei & Jianzhou Wang & Kailai Ni & Guangyu Tang, 2019. "Research and Application of a Novel Hybrid Model Based on a Deep Neural Network Combined with Fuzzy Time Series for Energy Forecasting," Energies, MDPI, vol. 12(18), pages 1-38, September.
    20. Gonçalves, Rui & Ribeiro, Vitor Miguel & Pereira, Fernando Lobo, 2023. "Variable Split Convolutional Attention: A novel Deep Learning model applied to the household electric power consumption," Energy, Elsevier, vol. 274(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:8:p:3446-:d:1123574. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.