IDEAS home Printed from https://ideas.repec.org/a/plo/pone00/0299632.html
   My bibliography  Save this article

Ultra short term power load forecasting based on the fusion of Seq2Seq BiLSTM and multi head attention mechanism

Author

Listed:
  • Yuanfang Gou
  • Cheng Guo
  • Risheng Qin

Abstract

Ultra-short-term power load forecasting is beneficial to improve the economic efficiency of power systems and ensure the safe and stable operation of power grids. As the volatility and randomness of loads in power systems, make it difficult to achieve accurate and reliable power load forecasting, a sequence-to-sequence based learning framework is proposed to learn feature information in different dimensions synchronously. Convolutional Neural Networks(CNN) Combined with Bidirectional Long Short Term Memory(BiLSTM) Networks is constructed in the encoder to extract the correlated timing features embedded in external factors affecting power loads. The parallel BiLSTM network is constructed in the decoder to mine the power load timing information in different regions separately. The multi-headed attention mechanism is introduced to fuse the BiLSTM hidden layer state information in different components to further highlight the key information representation. The load forecastion results in different regions are output through the fully connected layer. The model proposed in this paper has the advantage of high forecastion accuracy through the example analysis of real power load data.

Suggested Citation

  • Yuanfang Gou & Cheng Guo & Risheng Qin, 2024. "Ultra short term power load forecasting based on the fusion of Seq2Seq BiLSTM and multi head attention mechanism," PLOS ONE, Public Library of Science, vol. 19(3), pages 1-17, March.
  • Handle: RePEc:plo:pone00:0299632
    DOI: 10.1371/journal.pone.0299632
    as

    Download full text from publisher

    File URL: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0299632
    Download Restriction: no

    File URL: https://journals.plos.org/plosone/article/file?id=10.1371/journal.pone.0299632&type=printable
    Download Restriction: no

    File URL: https://libkey.io/10.1371/journal.pone.0299632?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Jihoon Moon & Yongsung Kim & Minjae Son & Eenjun Hwang, 2018. "Hybrid Short-Term Load Forecasting Scheme Using Random Forest and Multilayer Perceptron," Energies, MDPI, vol. 11(12), pages 1-20, November.
    2. Nasir Ayub & Muhammad Irfan & Muhammad Awais & Usman Ali & Tariq Ali & Mohammed Hamdi & Abdullah Alghamdi & Fazal Muhammad, 2020. "Big Data Analytics for Short and Medium-Term Electricity Load Forecasting Using an AI Techniques Ensembler," Energies, MDPI, vol. 13(19), pages 1-21, October.
    3. Zaki Masood & Rahma Gantassi & Ardiansyah & Yonghoon Choi, 2022. "A Multi-Step Time-Series Clustering-Based Seq2Seq LSTM Learning for a Single Household Electricity Load Forecasting," Energies, MDPI, vol. 15(7), pages 1-11, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu Lu & Wei Wei, 2023. "Influence of Public Sports Services on Residents’ Mental Health at Communities Level: New Insights from China," IJERPH, MDPI, vol. 20(2), pages 1-14, January.
    2. Bin Li & Mingzhen Lu & Yiyi Zhang & Jia Huang, 2019. "A Weekend Load Forecasting Model Based on Semi-Parametric Regression Analysis Considering Weather and Load Interaction," Energies, MDPI, vol. 12(20), pages 1-19, October.
    3. Seung-Min Jung & Sungwoo Park & Seung-Won Jung & Eenjun Hwang, 2020. "Monthly Electric Load Forecasting Using Transfer Learning for Smart Cities," Sustainability, MDPI, vol. 12(16), pages 1-20, August.
    4. Stanislaw Osowski & Robert Szmurlo & Krzysztof Siwek & Tomasz Ciechulski, 2022. "Neural Approaches to Short-Time Load Forecasting in Power Systems—A Comparative Study," Energies, MDPI, vol. 15(9), pages 1-21, April.
    5. Sun-Youn Shin & Han-Gyun Woo, 2022. "Energy Consumption Forecasting in Korea Using Machine Learning Algorithms," Energies, MDPI, vol. 15(13), pages 1-20, July.
    6. Sungwoo Park & Jihoon Moon & Seungwon Jung & Seungmin Rho & Sung Wook Baik & Eenjun Hwang, 2020. "A Two-Stage Industrial Load Forecasting Scheme for Day-Ahead Combined Cooling, Heating and Power Scheduling," Energies, MDPI, vol. 13(2), pages 1-23, January.
    7. Khan, Taimoor & Choi, Chang, 2025. "Attention enhanced dual stream network with advanced feature selection for power forecasting," Applied Energy, Elsevier, vol. 377(PC).
    8. Sajawal ur Rehman Khan & Israa Adil Hayder & Muhammad Asif Habib & Mudassar Ahmad & Syed Muhammad Mohsin & Farrukh Aslam Khan & Kainat Mustafa, 2022. "Enhanced Machine-Learning Techniques for Medium-Term and Short-Term Electric-Load Forecasting in Smart Grids," Energies, MDPI, vol. 16(1), pages 1-16, December.
    9. Shahzad Aslam & Nasir Ayub & Umer Farooq & Muhammad Junaid Alvi & Fahad R. Albogamy & Gul Rukh & Syed Irtaza Haider & Ahmad Taher Azar & Rasool Bukhsh, 2021. "Towards Electric Price and Load Forecasting Using CNN-Based Ensembler in Smart Grid," Sustainability, MDPI, vol. 13(22), pages 1-28, November.
    10. Changzhi Li & Dandan Liu & Mao Wang & Hanlin Wang & Shuai Xu, 2023. "Detection of Outliers in Time Series Power Data Based on Prediction Errors," Energies, MDPI, vol. 16(2), pages 1-19, January.
    11. Ding, Zhikun & Chen, Weilin & Hu, Ting & Xu, Xiaoxiao, 2021. "Evolutionary double attention-based long short-term memory model for building energy prediction: Case study of a green building," Applied Energy, Elsevier, vol. 288(C).
    12. Athanasios Ioannis Arvanitidis & Dimitrios Bargiotas & Aspassia Daskalopulu & Dimitrios Kontogiannis & Ioannis P. Panapakidis & Lefteri H. Tsoukalas, 2022. "Clustering Informed MLP Models for Fast and Accurate Short-Term Load Forecasting," Energies, MDPI, vol. 15(4), pages 1-14, February.
    13. Yuhong Xie & Yuzuru Ueda & Masakazu Sugiyama, 2021. "A Two-Stage Short-Term Load Forecasting Method Using Long Short-Term Memory and Multilayer Perceptron," Energies, MDPI, vol. 14(18), pages 1-17, September.
    14. Abdulwahab Ali Almazroi & Ch Anwar Ul Hassan, 2023. "Nature-inspired solutions for energy sustainability using novel optimization methods," PLOS ONE, Public Library of Science, vol. 18(11), pages 1-37, November.
    15. Fatma Yaprakdal & M. Berkay Yılmaz & Mustafa Baysal & Amjad Anvari-Moghaddam, 2020. "A Deep Neural Network-Assisted Approach to Enhance Short-Term Optimal Operational Scheduling of a Microgrid," Sustainability, MDPI, vol. 12(4), pages 1-27, February.
    16. Prajowal Manandhar & Hasan Rafiq & Edwin Rodriguez-Ubinas & Juan David Barbosa & Omer Ahmed Qureshi & Mahmoud Tarek & Sgouris Sgouridis, 2022. "Understanding Energy Behavioral Changes Due to COVID-19 in the Residents of Dubai Using Electricity Consumption Data and Their Impacts," Energies, MDPI, vol. 16(1), pages 1-23, December.
    17. Deyslen Mariano-Hernández & Luis Hernández-Callejo & Martín Solís & Angel Zorita-Lamadrid & Oscar Duque-Pérez & Luis Gonzalez-Morales & Felix Santos García & Alvaro Jaramillo-Duque & Adalberto Ospino-, 2022. "Analysis of the Integration of Drift Detection Methods in Learning Algorithms for Electrical Consumption Forecasting in Smart Buildings," Sustainability, MDPI, vol. 14(10), pages 1-14, May.
    18. Winita Sulandari & Yudho Yudhanto & Paulo Canas Rodrigues, 2022. "The Use of Singular Spectrum Analysis and K-Means Clustering-Based Bootstrap to Improve Multistep Ahead Load Forecasting," Energies, MDPI, vol. 15(16), pages 1-22, August.
    19. Peng Liu & Peijun Zheng & Ziyu Chen, 2019. "Deep Learning with Stacked Denoising Auto-Encoder for Short-Term Electric Load Forecasting," Energies, MDPI, vol. 12(12), pages 1-15, June.
    20. Neilson Luniere Vilaça & Marly Guimarães Fernandes Costa & Cicero Ferreira Fernandes Costa Filho, 2023. "A Hybrid Deep Neural Network Architecture for Day-Ahead Electricity Forecasting: Post-COVID Paradigm," Energies, MDPI, vol. 16(8), pages 1-14, April.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:plo:pone00:0299632. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: plosone (email available below). General contact details of provider: https://journals.plos.org/plosone/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.