IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v12y2019i24p4612-d294226.html
   My bibliography  Save this article

A Hybrid Short-Term Load Forecasting Framework with an Attention-Based Encoder–Decoder Network Based on Seasonal and Trend Adjustment

Author

Listed:
  • Zhaorui Meng

    (Electronic information school, Wuhan University, Wuhan 430072, China
    School of computer and information engineering, Xiamen University of Technology, Xiamen 361024, China)

  • Xianze Xu

    (Electronic information school, Wuhan University, Wuhan 430072, China)

Abstract

Accurate electrical load forecasting plays an important role in power system operation. An effective load forecasting approach can improve the operation efficiency of a power system. This paper proposes the seasonal and trend adjustment attention encoder–decoder (STA–AED), a hybrid short-term load forecasting approach based on a multi-head attention encoder–decoder module with seasonal and trend adjustment. A seasonal and trend decomposing technique is used to preprocess the original electrical load data. Each decomposed datum is regressed to predict the future electric load value by utilizing the encoder–decoder network with the multi-head attention mechanism. With the multi-head attention mechanism, STA–AED can interpret the prediction results more effectively. A large number of experiments and extensive comparisons have been carried out with a load forecasting dataset from the United States. The proposed hybrid STA–AED model is superior to the other five counterpart models such as random forest, gradient boosting decision tree (GBDT), gated recurrent units (GRUs), Encoder–Decoder, and Encoder–Decoder with multi-head attention. The proposed hybrid model shows the best prediction accuracy in 14 out of 15 zones in terms of both root mean square error (RMSE) and mean absolute percentage error (MAPE).

Suggested Citation

  • Zhaorui Meng & Xianze Xu, 2019. "A Hybrid Short-Term Load Forecasting Framework with an Attention-Based Encoder–Decoder Network Based on Seasonal and Trend Adjustment," Energies, MDPI, vol. 12(24), pages 1-14, December.
    • Handle: RePEc:gam:jeners:v:12:y:2019:i:24:p:4612-:d:294226
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/12/24/4612/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/12/24/4612/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yukseltan, Ergun & Yucekaya, Ahmet & Bilge, Ayse Humeyra, 2017. "Forecasting electricity demand for Turkey: Modeling periodic variations and demand segregation," Applied Energy, Elsevier, vol. 193(C), pages 287-296.
    2. Ben Taieb, Souhaib & Hyndman, Rob J., 2014. "A gradient boosting approach to the Kaggle load forecasting competition," International Journal of Forecasting, Elsevier, vol. 30(2), pages 382-394.
    3. Wang, Jianjun & Li, Li & Niu, Dongxiao & Tan, Zhongfu, 2012. "An annual load forecasting model based on support vector regression with differential evolution algorithm," Applied Energy, Elsevier, vol. 94(C), pages 65-70.
    4. Lloyd, James Robert, 2014. "GEFCom2012 hierarchical load forecasting: Gradient boosting machines and Gaussian processes," International Journal of Forecasting, Elsevier, vol. 30(2), pages 369-374.
    5. Yixing Wang & Meiqin Liu & Zhejing Bao & Senlin Zhang, 2018. "Short-Term Load Forecasting with Multi-Source Data Using Gated Recurrent Unit Neural Networks," Energies, MDPI, vol. 11(5), pages 1-19, May.
    6. Chen, Yongbao & Xu, Peng & Chu, Yiyi & Li, Weilin & Wu, Yuntao & Ni, Lizhou & Bao, Yi & Wang, Kun, 2017. "Short-term electrical load forecasting using the Support Vector Regression (SVR) model to calculate the demand response baseline for office buildings," Applied Energy, Elsevier, vol. 195(C), pages 659-670.
    7. Vu, D.H. & Muttaqi, K.M. & Agalgaonkar, A.P. & Bouzerdoum, A., 2017. "Short-term electricity demand forecasting using autoregressive based time varying model incorporating representative data adjustment," Applied Energy, Elsevier, vol. 205(C), pages 790-801.
    8. Raza, Muhammad Qamar & Khosravi, Abbas, 2015. "A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 50(C), pages 1352-1372.
    9. Tripathi, M.M. & Upadhyay, K.G. & Singh, S.N., 2008. "Short-Term Load Forecasting Using Generalized Regression and Probabilistic Neural Networks in the Electricity Market," The Electricity Journal, Elsevier, vol. 21(9), pages 24-34, November.
    10. Liu, Nian & Tang, Qingfeng & Zhang, Jianhua & Fan, Wei & Liu, Jie, 2014. "A hybrid forecasting model with parameter optimization for short-term load forecasting of micro-grids," Applied Energy, Elsevier, vol. 129(C), pages 336-345.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chatterjee, Joyjit & Dethlefs, Nina, 2021. "Scientometric review of artificial intelligence for operations & maintenance of wind turbines: The past, present and future," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiao, Liye & Shao, Wei & Wang, Chen & Zhang, Kequan & Lu, Haiyan, 2016. "Research and application of a hybrid model based on multi-objective optimization for electrical load forecasting," Applied Energy, Elsevier, vol. 180(C), pages 213-233.
    2. Guo, Zhifeng & Zhou, Kaile & Zhang, Xiaoling & Yang, Shanlin, 2018. "A deep learning model for short-term power load and probability density forecasting," Energy, Elsevier, vol. 160(C), pages 1186-1200.
    3. Wang, Deyun & Yue, Chenqiang & ElAmraoui, Adnen, 2021. "Multi-step-ahead electricity load forecasting using a novel hybrid architecture with decomposition-based error correction strategy," Chaos, Solitons & Fractals, Elsevier, vol. 152(C).
    4. Fan, Guo-Feng & Peng, Li-Ling & Hong, Wei-Chiang, 2018. "Short term load forecasting based on phase space reconstruction algorithm and bi-square kernel regression model," Applied Energy, Elsevier, vol. 224(C), pages 13-33.
    5. Seyedeh Narjes Fallah & Mehdi Ganjkhani & Shahaboddin Shamshirband & Kwok-wing Chau, 2019. "Computational Intelligence on Short-Term Load Forecasting: A Methodological Overview," Energies, MDPI, vol. 12(3), pages 1-21, January.
    6. Xiao, Liye & Shao, Wei & Liang, Tulu & Wang, Chen, 2016. "A combined model based on multiple seasonal patterns and modified firefly algorithm for electrical load forecasting," Applied Energy, Elsevier, vol. 167(C), pages 135-153.
    7. Bingjie Jin & Guihua Zeng & Zhilin Lu & Hongqiao Peng & Shuxin Luo & Xinhe Yang & Haojun Zhu & Mingbo Liu, 2022. "Hybrid LSTM–BPNN-to-BPNN Model Considering Multi-Source Information for Forecasting Medium- and Long-Term Electricity Peak Load," Energies, MDPI, vol. 15(20), pages 1-20, October.
    8. Jonathan Berrisch & Micha{l} Narajewski & Florian Ziel, 2022. "High-Resolution Peak Demand Estimation Using Generalized Additive Models and Deep Neural Networks," Papers 2203.03342, arXiv.org, revised Nov 2022.
    9. Döpke, Jörg & Fritsche, Ulrich & Pierdzioch, Christian, 2017. "Predicting recessions with boosted regression trees," International Journal of Forecasting, Elsevier, vol. 33(4), pages 745-759.
    10. Ma, Weiwu & Fang, Song & Liu, Gang & Zhou, Ruoyu, 2017. "Modeling of district load forecasting for distributed energy system," Applied Energy, Elsevier, vol. 204(C), pages 181-205.
    11. Antonopoulos, Ioannis & Robu, Valentin & Couraud, Benoit & Kirli, Desen & Norbu, Sonam & Kiprakis, Aristides & Flynn, David & Elizondo-Gonzalez, Sergio & Wattam, Steve, 2020. "Artificial intelligence and machine learning approaches to energy demand-side response: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    12. Xu, Lei & Wang, Shengwei & Tang, Rui, 2019. "Probabilistic load forecasting for buildings considering weather forecasting uncertainty and uncertain peak load," Applied Energy, Elsevier, vol. 237(C), pages 180-195.
    13. Chujie Tian & Jian Ma & Chunhong Zhang & Panpan Zhan, 2018. "A Deep Neural Network Model for Short-Term Load Forecast Based on Long Short-Term Memory Network and Convolutional Neural Network," Energies, MDPI, vol. 11(12), pages 1-13, December.
    14. Li, Wei-Qin & Chang, Li, 2018. "A combination model with variable weight optimization for short-term electrical load forecasting," Energy, Elsevier, vol. 164(C), pages 575-593.
    15. Luo, Jian & Hong, Tao & Fang, Shu-Cherng, 2018. "Benchmarking robustness of load forecasting models under data integrity attacks," International Journal of Forecasting, Elsevier, vol. 34(1), pages 89-104.
    16. Tongxiang Liu & Yu Jin & Yuyang Gao, 2019. "A New Hybrid Approach for Short-Term Electric Load Forecasting Applying Support Vector Machine with Ensemble Empirical Mode Decomposition and Whale Optimization," Energies, MDPI, vol. 12(8), pages 1-20, April.
    17. Khoshrou, Abdolrahman & Pauwels, Eric J., 2019. "Short-term scenario-based probabilistic load forecasting: A data-driven approach," Applied Energy, Elsevier, vol. 238(C), pages 1258-1268.
    18. Wang, Jianzhou & Xing, Qianyi & Zeng, Bo & Zhao, Weigang, 2022. "An ensemble forecasting system for short-term power load based on multi-objective optimizer and fuzzy granulation," Applied Energy, Elsevier, vol. 327(C).
    19. Ali K k & Erg n Y kseltan & Mustafa Hekimo lu & Esra Agca Aktunc & Ahmet Y cekaya & Ay e Bilge, 2022. "Forecasting Hourly Electricity Demand Under COVID-19 Restrictions," International Journal of Energy Economics and Policy, Econjournals, vol. 12(1), pages 73-85.
    20. Sekhar, Charan & Dahiya, Ratna, 2023. "Robust framework based on hybrid deep learning approach for short term load forecasting of building electricity demand," Energy, Elsevier, vol. 268(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:12:y:2019:i:24:p:4612-:d:294226. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.