IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v293y2024ics0360544224004389.html

CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability

Author

Listed:
  • Tian, Zhirui
  • Liu, Weican
  • Jiang, Wenqian
  • Wu, Chenye

Abstract

Independent system operators (ISOs) are pursuing day-ahead probabilistic load forecasting as it offers comprehensive load trend and pattern information. Compared with commonly adopted point forecasting, it enables ISOs to better understand the uncertainty of future demand through interval forecasting with varying confidence levels. In practice, this advantage could enable precise day-ahead forecasting for critical days with irregular load patterns (e.g., weekends or holidays), particularly when the data availability is limited. To this end, we customize a day-ahead probabilistic load forecasting framework with an emphasis on weekends based on data processing and probabilistic deep learning. Specifically, data processing combines data denoising and data augmentation techniques, incorporating peak and trend information into the denoised one-dimensional time series data to aid training. This procedure helps extract more information from the restricted training samples. The probabilistic deep learning, CNNs-Transformer, combines multi-layer Convolutional Neural Networks and Transformer, adopting QRLoss (quantile regression loss function) to achieve probabilistic forecasting. The loss penalty technique enhances the model’s attention to weekend data. Numerical studies based on field data suggest that the proposed framework can obtain accurate day-ahead probabilistic forecasting results (48-time points of the whole day) by using only two-week historical data, and the accuracy improvement over its rivals is remarkable on weekends.

Suggested Citation

  • Tian, Zhirui & Liu, Weican & Jiang, Wenqian & Wu, Chenye, 2024. "CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability," Energy, Elsevier, vol. 293(C).
  • Handle: RePEc:eee:energy:v:293:y:2024:i:c:s0360544224004389
    DOI: 10.1016/j.energy.2024.130666
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224004389
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.130666?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," Applied Energy, Elsevier, vol. 301(C).
    2. Wang, Jianzhou & Xing, Qianyi & Zeng, Bo & Zhao, Weigang, 2022. "An ensemble forecasting system for short-term power load based on multi-objective optimizer and fuzzy granulation," Applied Energy, Elsevier, vol. 327(C).
    3. Morais, Lucas Barros Scianni & Aquila, Giancarlo & de Faria, Victor Augusto Durães & Lima, Luana Medeiros Marangon & Lima, José Wanderley Marangon & de Queiroz, Anderson Rodrigo, 2023. "Short-term load forecasting using neural networks and global climate models: An application to a large-scale electrical power system," Applied Energy, Elsevier, vol. 348(C).
    4. Tian, Zhirui & Gai, Mei, 2023. "A novel hybrid wind speed prediction framework based on multi-strategy improved optimizer and new data pre-processing system with feedback mechanism," Energy, Elsevier, vol. 281(C).
    5. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    6. Huang, Qian & Li, Jinghua & Zhu, Mengshu, 2020. "An improved convolutional neural network with load range discretization for probabilistic load forecasting," Energy, Elsevier, vol. 203(C).
    7. Fu, Wenlong & Fu, Yuchen & Li, Bailing & Zhang, Hairong & Zhang, Xuanrui & Liu, Jiarui, 2023. "A compound framework incorporating improved outlier detection and correction, VMD, weight-based stacked generalization with enhanced DESMA for multi-step short-term wind speed forecasting," Applied Energy, Elsevier, vol. 348(C).
    8. Zhao, Zhenyu & Zhang, Yao & Yang, Yujia & Yuan, Shuguang, 2022. "Load forecasting via Grey Model-Least Squares Support Vector Machine model and spatial-temporal distribution of electric consumption intensity," Energy, Elsevier, vol. 255(C).
    9. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).
    10. Lv, Zhihan & Wang, Nana & Lou, Ranran & Tian, Yajun & Guizani, Mohsen, 2023. "Towards carbon Neutrality: Prediction of wave energy based on improved GRU in Maritime transportation," Applied Energy, Elsevier, vol. 331(C).
    11. Zhu, Bangzhu & Wan, Chunzhuo & Wang, Ping, 2022. "Interval forecasting of carbon price: A novel multiscale ensemble forecasting approach," Energy Economics, Elsevier, vol. 115(C).
    12. Wang, Yun & Xu, Houhua & Song, Mengmeng & Zhang, Fan & Li, Yifen & Zhou, Shengchao & Zhang, Lingjun, 2023. "A convolutional Transformer-based truncated Gaussian density network with data denoising for wind speed forecasting," Applied Energy, Elsevier, vol. 333(C).
    13. Lai, Changzhi & Wang, Yu & Fan, Kai & Cai, Qilin & Ye, Qing & Pang, Haoqiang & Wu, Xi, 2022. "An improved forecasting model of short-term electric load of papermaking enterprises for production line optimization," Energy, Elsevier, vol. 245(C).
    14. Tang, Mengcheng & Zhuang, Weichao & Li, Bingbing & Liu, Haoji & Song, Ziyou & Yin, Guodong, 2023. "Energy-optimal routing for electric vehicles using deep reinforcement learning with transformer," Applied Energy, Elsevier, vol. 350(C).
    15. Tian, Zhirui & Wang, Jiyang, 2023. "A wind speed prediction system based on new data preprocessing strategy and improved multi-objective optimizer," Renewable Energy, Elsevier, vol. 215(C).
    16. Rubasinghe, Osaka & Zhang, Tingze & Zhang, Xinan & Choi, San Shing & Chau, Tat Kei & Chow, Yau & Fernando, Tyrone & Iu, Herbert Ho-Ching, 2023. "Highly accurate peak and valley prediction short-term net load forecasting approach based on decomposition for power systems with high PV penetration," Applied Energy, Elsevier, vol. 333(C).
    17. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    18. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," LSE Research Online Documents on Economics 120774, London School of Economics and Political Science, LSE Library.
    19. Chaturvedi, Shobhit & Rajasekar, Elangovan & Natarajan, Sukumar & McCullen, Nick, 2022. "A comparative assessment of SARIMA, LSTM RNN and Fb Prophet models to forecast total and peak monthly energy demand for India," Energy Policy, Elsevier, vol. 168(C).
    20. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).
    21. Li, Jinghua & Luo, Yichen & Wei, Shanyang, 2022. "Long-term electricity consumption forecasting method based on system dynamics under the carbon-neutral target," Energy, Elsevier, vol. 244(PA).
    22. Niu, Dongxiao & Yu, Min & Sun, Lijie & Gao, Tian & Wang, Keke, 2022. "Short-term multi-energy load forecasting for integrated energy systems based on CNN-BiGRU optimized by attention mechanism," Applied Energy, Elsevier, vol. 313(C).
    23. Abou Houran, Mohamad & Salman Bukhari, Syed M. & Zafar, Muhammad Hamza & Mansoor, Majad & Chen, Wenjie, 2023. "COA-CNN-LSTM: Coati optimization algorithm-based hybrid deep learning model for PV/wind power forecasting in smart grid applications," Applied Energy, Elsevier, vol. 349(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liu, Tianhao & Li, Fangning & Zhang, Dongdong & Shan, Linke & Zhu, Hongyu & Du, Pengcheng & Jiang, Meihui & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Kong, Fannie, 2026. "Intelligent load forecasting technologies for diverse scenarios in the new power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PD).
    2. Duan, Pengfei & Zhao, Xiaoyu & Hu, Jinxue & Li, Kang & Xue, Qingwen & Cao, Xiaodong & Wang, Yanmin & Zhao, Bingxu & Zhang, Chenyang & Yuan, Xiaoyang, 2026. "Multi-energy load forecasting incorporating AI algorithms: research status and trends in integrated energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 229(C).
    3. Xu, Huifeng & Hu, Feihu & Liang, Xinhao & Zhao, Guoqing & Abugunmi, Mohammad, 2024. "A framework for electricity load forecasting based on attention mechanism time series depthwise separable convolutional neural network," Energy, Elsevier, vol. 299(C).
    4. Sun, Yang & Tian, Zhirui, 2025. "Solving few-shot problem in wind speed prediction: A novel transfer strategy based on decomposition and learning ensemble," Applied Energy, Elsevier, vol. 377(PD).
    5. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Long-term price guidance mechanism for integrated energy systems based on gated recurrent unit - vision transformer prediction and fractional-order stochastic dynamic calculus control," Energy, Elsevier, vol. 312(C).
    6. Ren, Xiaoxiao & Tian, Xin & Wang, Kai & Yang, Sifan & Chen, Weixiong & Wang, Jinshi, 2025. "Enhanced load forecasting for distributed multi-energy system: A stacking ensemble learning method with deep reinforcement learning and model fusion," Energy, Elsevier, vol. 319(C).
    7. Wang, Ying & Li, Hongmin & Jahanger, Atif & Li, Qiwei & Wang, Biao & Balsalobre-Lorente, Daniel, 2024. "A novel ensemble electricity load forecasting system based on a decomposition-selection-optimization strategy," Energy, Elsevier, vol. 312(C).
    8. Tian, Zhirui & Liu, Weican & Zhang, Jiahao & Sun, Wenpu & Wu, Chenye, 2025. "EDformer family: End-to-end multi-task load forecasting frameworks for day-ahead economic dispatch," Applied Energy, Elsevier, vol. 383(C).
    9. Xing, Qianyi & Huang, Xiaojia & Wang, Kang & Wang, Jianzhou & Wang, Shuai, 2025. "MIG-EWPFS: An ensemble probabilistic wind speed forecasting system integrating multi-dimensional feature extraction, hybrid quantile regression, and Knee improved multi-objective optimization," Energy, Elsevier, vol. 324(C).
    10. Yifei Chen & Zhihan Fu, 2023. "Multi-Step Ahead Forecasting of the Energy Consumed by the Residential and Commercial Sectors in the United States Based on a Hybrid CNN-BiLSTM Model," Sustainability, MDPI, vol. 15(3), pages 1-21, January.
    11. Tian, Zhirui & Sun, Wenpu & Wu, Chenye, 2025. "MLP-Carbon: A new paradigm integrating multi-frequency and multi-scale techniques for accurate carbon price forecasting," Applied Energy, Elsevier, vol. 383(C).
    12. Hu, Rong & Zhou, Kaile & Lu, Xinhui, 2025. "Integrated loads forecasting with absence of crucial factors," Energy, Elsevier, vol. 322(C).
    13. Meng, Anbo & Li, Hanhong & Yin, Hao & Li, Xuecong, 2025. "A novel net load prediction approach using multi-scale deep learning network based on Trend-Multi-Period encoder and segment imbalance regression," Energy, Elsevier, vol. 332(C).
    14. Wei, Xingchen & Wu, Xinyu & Yoshimura, Kei & Cheng, Chuntian & Huang, Hao & Ding, Zhendong & Song, Yuhang, 2025. "Climate-informed long-term forecasting of wind and photovoltaic power using a hybrid DWT–BES–CNN–LSTM model," Energy, Elsevier, vol. 338(C).
    15. Wang, Han & Yan, Jie & Zhang, Jiawei & Liu, Shihua & Liu, Yongqian & Han, Shuang & Qu, Tonghui, 2024. "Short-term integrated forecasting method for wind power, solar power, and system load based on variable attention mechanism and multi-task learning," Energy, Elsevier, vol. 304(C).
    16. Karamolegkos, Spyridon & Koulouriotis, Dimitrios E., 2025. "Advancing short-term load forecasting with decomposed Fourier ARIMA: A case study on the Greek energy market," Energy, Elsevier, vol. 325(C).
    17. Lin, Zhengyang & Lin, Tao & Li, Jun & Li, Chen, 2025. "A novel short-term multi-energy load forecasting method for integrated energy system based on two-layer joint modal decomposition and dynamic optimal ensemble learning," Applied Energy, Elsevier, vol. 378(PA).
    18. Cheng, Fang & Liu, Hui, 2024. "Multi-step electric vehicles charging loads forecasting: An autoformer variant with feature extraction, frequency enhancement, and error correction blocks," Applied Energy, Elsevier, vol. 376(PB).
    19. Wang, Tao & Xu, Ye & Qin, Yu & Wang, Xu & Zheng, Feifan & Li, Wei, 2025. "Short-term PV forecasting of multiple scenarios based on multi-dimensional clustering and hybrid transformer-BiLSTM with ECPO," Energy, Elsevier, vol. 334(C).
    20. Lu, Yakai & Peng, Xingyu & Li, Conghui & Tian, Zhe & Kong, Xiangfei & Niu, Jide, 2025. "Few-sample model training assistant: A meta-learning technique for building heating load forecasting based on simulation data," Energy, Elsevier, vol. 317(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:293:y:2024:i:c:s0360544224004389. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.