IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v327y2025ics036054422502033x.html
   My bibliography  Save this article

A probabilistic load forecasting method for multi-energy loads based on inflection point optimization and integrated feature screening

Author

Listed:
  • Zhao, Xiaoyu
  • Duan, Pengfei
  • Cao, Xiaodong
  • Xue, Qingwen
  • Zhao, Bingxu
  • Hu, Jinxue
  • Zhang, Chenyang
  • Yuan, Xiaoyang

Abstract

Aiming at the uncertainty and complexity of multi-energy load forecasting in integrated energy systems, this study proposes a hybrid Quantile Regression (QR) model based on Convolutional Neural Network (CNN)-Bidirectional Long Short-Term Memory (BiLSTM)-Time Step Attention. In the feature engineering phase, this model uses a method that combines Mutual Information and LightGBM for comprehensive variable analysis and feature screening to maximize the reduction of redundant features and avoid the omission of key feature variables. In the forecasting model, to address the problem of wide forecast ranges due to increased uncertainty at inflection points, an improved Quantile Regression Loss function is utilized to constrain the forecast intervals through a penalty mechanism, which narrows the forecast range while ensuring coverages. Furthermore, bayesian optimization is utilized to independently optimize the hyperparameters of the cold, heat, and electricity load respectively to match different load characteristics and improve the model training efficiency. The experimental results show that under the precondition of ensuring that the model forecast interval coverage is 100 %, when the Prediction Interval Nominal Confidence is 90 % and 95 %, the load prediction Average Interval Score of this model was reduced by an average of 36.74 %–51.48 % and 44.14 %–55.24 %, respectively.

Suggested Citation

  • Zhao, Xiaoyu & Duan, Pengfei & Cao, Xiaodong & Xue, Qingwen & Zhao, Bingxu & Hu, Jinxue & Zhang, Chenyang & Yuan, Xiaoyang, 2025. "A probabilistic load forecasting method for multi-energy loads based on inflection point optimization and integrated feature screening," Energy, Elsevier, vol. 327(C).
  • Handle: RePEc:eee:energy:v:327:y:2025:i:c:s036054422502033x
    DOI: 10.1016/j.energy.2025.136391
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S036054422502033X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2025.136391?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Sekhar, Charan & Dahiya, Ratna, 2023. "Robust framework based on hybrid deep learning approach for short term load forecasting of building electricity demand," Energy, Elsevier, vol. 268(C).
    2. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    3. Li, Yang & Wang, Ruinong & Li, Yuanzheng & Zhang, Meng & Long, Chao, 2023. "Wind power forecasting considering data privacy protection: A federated deep reinforcement learning approach," Applied Energy, Elsevier, vol. 329(C).
    4. Tian, Zhirui & Liu, Weican & Jiang, Wenqian & Wu, Chenye, 2024. "CNNs-Transformer based day-ahead probabilistic load forecasting for weekends with limited data availability," Energy, Elsevier, vol. 293(C).
    5. Li, Chuang & Li, Guojie & Wang, Keyou & Han, Bei, 2022. "A multi-energy load forecasting method based on parallel architecture CNN-GRU and transfer learning for data deficient integrated energy systems," Energy, Elsevier, vol. 259(C).
    6. Duan, Pengfei & Zhao, Bingxu & Zhang, Xinghui & Fen, Mengdan, 2023. "A day-ahead optimal operation strategy for integrated energy systems in multi-public buildings based on cooperative game," Energy, Elsevier, vol. 275(C).
    7. Hu, Jianming & Luo, Qingxi & Tang, Jingwei & Heng, Jiani & Deng, Yuwen, 2022. "Conformalized temporal convolutional quantile regression networks for wind power interval forecasting," Energy, Elsevier, vol. 248(C).
    8. Song, Cairong & Yang, Haidong & Cai, Jianyang & Yang, Pan & Bao, Hao & Xu, Kangkang & Meng, Xian-Bing, 2024. "Multi-energy load forecasting via hierarchical multi-task learning and spatiotemporal attention," Applied Energy, Elsevier, vol. 373(C).
    9. Brusaferri, Alessandro & Matteucci, Matteo & Spinelli, Stefano & Vitali, Andrea, 2022. "Probabilistic electric load forecasting through Bayesian Mixture Density Networks," Applied Energy, Elsevier, vol. 309(C).
    10. Joseph, Lionel P. & Deo, Ravinesh C. & Casillas-Pérez, David & Prasad, Ramendra & Raj, Nawin & Salcedo-Sanz, Sancho, 2024. "Short-term wind speed forecasting using an optimized three-phase convolutional neural network fused with bidirectional long short-term memory network model," Applied Energy, Elsevier, vol. 359(C).
    11. Gabriel Trierweiler Ribeiro & João Guilherme Sauer & Naylene Fraccanabbia & Viviana Cocco Mariani & Leandro dos Santos Coelho, 2020. "Bayesian Optimized Echo State Network Applied to Short-Term Load Forecasting," Energies, MDPI, vol. 13(9), pages 1-19, May.
    12. Wang, Jianzhou & Wang, Shuai & Zeng, Bo & Lu, Haiyan, 2022. "A novel ensemble probabilistic forecasting system for uncertainty in wind speed," Applied Energy, Elsevier, vol. 313(C).
    13. Zhu, Jianhua & He, Yaoyao, 2025. "A novel hybrid model based on evolving multi-quantile long and short-term memory neural network for ultra-short-term probabilistic forecasting of photovoltaic power," Applied Energy, Elsevier, vol. 377(PC).
    14. Li, Kang & Duan, Pengfei & Cao, Xiaodong & Cheng, Yuanda & Zhao, Bingxu & Xue, Qingwen & Feng, Mengdan, 2024. "A multi-energy load forecasting method based on complementary ensemble empirical model decomposition and composite evaluation factor reconstruction," Applied Energy, Elsevier, vol. 365(C).
    15. Chung, Won Hee & Gu, Yeong Hyeon & Yoo, Seong Joon, 2022. "District heater load forecasting based on machine learning and parallel CNN-LSTM attention," Energy, Elsevier, vol. 246(C).
    16. Zhong, Shengyuan & Zhao, Jun & Li, Wenjia & Li, Hao & Deng, Shuai & Li, Yang & Hussain, Sajjad & Wang, Xiaoyuan & Zhu, Jiebei, 2021. "Quantitative analysis of information interaction in building energy systems based on mutual information," Energy, Elsevier, vol. 214(C).
    17. Zhang, Chu & Qiao, Xiujie & Zhang, Zhao & Wang, Yuhan & Fu, Yongyan & Nazir, Muhammad Shahzad & Peng, Tian, 2024. "Simultaneous forecasting of wind speed for multiple stations based on attribute-augmented spatiotemporal graph convolutional network and tree-structured parzen estimator," Energy, Elsevier, vol. 295(C).
    18. Chen, Wenhao & Rong, Fei & Lin, Chuan, 2025. "A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit," Energy, Elsevier, vol. 320(C).
    19. Wang, Jianzhou & Niu, Xinsong & Zhang, Lifang & Liu, Zhenkun & Wei, Danxiang, 2022. "The influence of international oil prices on the exchange rates of oil exporting countries: Based on the hybrid copula function," Resources Policy, Elsevier, vol. 77(C).
    20. Aslam, Sheraz & Herodotou, Herodotos & Mohsin, Syed Muhammad & Javaid, Nadeem & Ashraf, Nouman & Aslam, Shahzad, 2021. "A survey on deep learning methods for power load and renewable energy forecasting in smart microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    21. Fan, Jingmin & Zhong, Mingwei & Guan, Yuanpeng & Yi, Siqi & Xu, Cancheng & Zhai, Yanpeng & Zhou, Yongwang, 2024. "An online long-term load forecasting method: Hierarchical highway network based on crisscross feature collaboration," Energy, Elsevier, vol. 299(C).
    22. Yang, Yi & Xing, Qianyi & Wang, Kang & Li, Caihong & Wang, Jianzhou & Huang, Xiaojia, 2024. "A novel combined probabilistic load forecasting system integrating hybrid quantile regression and knee improved multi-objective optimization strategy," Applied Energy, Elsevier, vol. 356(C).
    23. Chen, Haoyu & Huang, Hai & Zheng, Yong & Yang, Bing, 2024. "A load forecasting approach for integrated energy systems based on aggregation hybrid modal decomposition and combined model," Applied Energy, Elsevier, vol. 375(C).
    24. Zhao, Bingxu & Cao, Xiaodong & Duan, Pengfei, 2024. "Cooperative operation of multiple low-carbon microgrids: An optimization study addressing gaming fraud and multiple uncertainties," Energy, Elsevier, vol. 297(C).
    25. Tan, Mao & Liao, Chengchen & Chen, Jie & Cao, Yijia & Wang, Rui & Su, Yongxin, 2023. "A multi-task learning method for multi-energy load forecasting based on synthesis correlation analysis and load participation factor," Applied Energy, Elsevier, vol. 343(C).
    26. Xie, Xiangmin & Ding, Yuhao & Sun, Yuanyuan & Zhang, Zhisheng & Fan, Jianhua, 2024. "A novel time-series probabilistic forecasting method for multi-energy loads," Energy, Elsevier, vol. 306(C).
    27. Niu, Dongxiao & Sun, Lijie & Yu, Min & Wang, Keke, 2022. "Point and interval forecasting of ultra-short-term wind power based on a data-driven method and hybrid deep learning model," Energy, Elsevier, vol. 254(PA).
    28. Wan, Anping & Chang, Qing & AL-Bukhaiti, Khalil & He, Jiabo, 2023. "Short-term power load forecasting for combined heat and power using CNN-LSTM enhanced by attention mechanism," Energy, Elsevier, vol. 282(C).
    29. Zulfiqar, M. & Kamran, M. & Rasheed, M.B. & Alquthami, T. & Milyani, A.H., 2023. "A hybrid framework for short term load forecasting with a navel feature engineering and adaptive grasshopper optimization in smart grid," Applied Energy, Elsevier, vol. 338(C).
    30. Salimian Rizi, Behzad & Pavlak, Gregory & Cushing, Vincent & Heidarinejad, Mohammad, 2023. "Predicting uncertainty of a chiller plant power consumption using quantile random forest: A commercial building case study," Energy, Elsevier, vol. 283(C).
    31. Hafeez, Ghulam & Alimgeer, Khurram Saleem & Khan, Imran, 2020. "Electric load forecasting based on deep learning and optimized by heuristic algorithm in smart grid," Applied Energy, Elsevier, vol. 269(C).
    32. Zhang, Shu & Wang, Yi & Zhang, Yutian & Wang, Dan & Zhang, Ning, 2020. "Load probability density forecasting by transforming and combining quantile forecasts," Applied Energy, Elsevier, vol. 277(C).
    33. Moreno, Sinvaldo Rodrigues & Seman, Laio Oriel & Stefenon, Stefano Frizzo & Coelho, Leandro dos Santos & Mariani, Viviana Cocco, 2024. "Enhancing wind speed forecasting through synergy of machine learning, singular spectral analysis, and variational mode decomposition," Energy, Elsevier, vol. 292(C).
    34. Yan, Qin & Lu, Zhiying & Liu, Hong & He, Xingtang & Zhang, Xihai & Guo, Jianlin, 2024. "Short-term prediction of integrated energy load aggregation using a bi-directional simple recurrent unit network with feature-temporal attention mechanism ensemble learning model," Applied Energy, Elsevier, vol. 355(C).
    35. Wang, Yunqi & Qiu, Jing & Tao, Yuechuan, 2022. "Robust energy systems scheduling considering uncertainties and demand side emission impacts," Energy, Elsevier, vol. 239(PD).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yang, Yi & Xing, Qianyi & Wang, Kang & Li, Caihong & Wang, Jianzhou & Huang, Xiaojia, 2024. "A novel combined probabilistic load forecasting system integrating hybrid quantile regression and knee improved multi-objective optimization strategy," Applied Energy, Elsevier, vol. 356(C).
    2. Wang, Danhao & Peng, Daogang & Huang, Dongmei & Zhao, Huirong & Qu, Bogang, 2025. "MMEMformer: A multi-scale memory-enhanced transformer framework for short-term load forecasting in integrated energy systems," Energy, Elsevier, vol. 322(C).
    3. Yin, Linfei & Ju, Linyi, 2025. "ShuffleTransformerMulti-headAttentionNet network for user load forecasting," Energy, Elsevier, vol. 322(C).
    4. Xu, Huifeng & Hu, Feihu & Liang, Xinhao & Zhao, Guoqing & Abugunmi, Mohammad, 2024. "A framework for electricity load forecasting based on attention mechanism time series depthwise separable convolutional neural network," Energy, Elsevier, vol. 299(C).
    5. Chen, Wenhao & Rong, Fei & Lin, Chuan, 2025. "A multi-energy loads forecasting model based on dual attention mechanism and multi-scale hierarchical residual network with gated recurrent unit," Energy, Elsevier, vol. 320(C).
    6. Zhang, Dongxue & Wang, Shuai & Liang, Yuqiu & Du, Zhiyuan, 2023. "A novel combined model for probabilistic load forecasting based on deep learning and improved optimizer," Energy, Elsevier, vol. 264(C).
    7. Liao, Chengchen & Tan, Mao & Li, Kang & Chen, Jie & Wang, Rui & Su, Yongxin, 2024. "Sequence signal prediction and reconstruction for multi-energy load forecasting in integrated energy systems: A bi-level multi-task learning method," Energy, Elsevier, vol. 313(C).
    8. Fan, Pengdan & Wang, Dan & Wang, Wei & Zhang, Xiuyu & Sun, Yuying, 2024. "A novel multi-energy load forecasting method based on building flexibility feature recognition technology and multi-task learning model integrating LSTM," Energy, Elsevier, vol. 308(C).
    9. Ren, Xiaoxiao & Tian, Xin & Wang, Kai & Yang, Sifan & Chen, Weixiong & Wang, Jinshi, 2025. "Enhanced load forecasting for distributed multi-energy system: A stacking ensemble learning method with deep reinforcement learning and model fusion," Energy, Elsevier, vol. 319(C).
    10. Xing, Qianyi & Huang, Xiaojia & Wang, Kang & Wang, Jianzhou & Wang, Shuai, 2025. "MIG-EWPFS: An ensemble probabilistic wind speed forecasting system integrating multi-dimensional feature extraction, hybrid quantile regression, and Knee improved multi-objective optimization," Energy, Elsevier, vol. 324(C).
    11. Gomez, William & Wang, Fu-Kwun & Lo, Shih-Che, 2024. "A hybrid approach based machine learning models in electricity markets," Energy, Elsevier, vol. 289(C).
    12. Hu, Rong & Zhou, Kaile & Lu, Xinhui, 2025. "Integrated loads forecasting with absence of crucial factors," Energy, Elsevier, vol. 322(C).
    13. Ehsani, Behdad & Pineau, Pierre-Olivier & Charlin, Laurent, 2024. "Price forecasting in the Ontario electricity market via TriConvGRU hybrid model: Univariate vs. multivariate frameworks," Applied Energy, Elsevier, vol. 359(C).
    14. Xiaoyu Liu & Jiangfeng Song & Hai Tao & Peng Wang & Haihua Mo & Wenjie Du, 2025. "Quarter-Hourly Power Load Forecasting Based on a Hybrid CNN-BiLSTM-Attention Model with CEEMDAN, K-Means, and VMD," Energies, MDPI, vol. 18(11), pages 1-29, May.
    15. Hisham Alghamdi & Ghulam Hafeez & Sajjad Ali & Safeer Ullah & Muhammad Iftikhar Khan & Sadia Murawwat & Lyu-Guang Hua, 2023. "An Integrated Model of Deep Learning and Heuristic Algorithm for Load Forecasting in Smart Grid," Mathematics, MDPI, vol. 11(21), pages 1-22, November.
    16. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Fractional-order long-term price guidance mechanism based on bidirectional prediction with attention mechanism for electric vehicle charging," Energy, Elsevier, vol. 293(C).
    17. Hu, Likun & Cao, Yi & Yin, Linfei, 2024. "Long-term price guidance mechanism for integrated energy systems based on gated recurrent unit - vision transformer prediction and fractional-order stochastic dynamic calculus control," Energy, Elsevier, vol. 312(C).
    18. Wang, Jianguo & Han, Lincheng & Zhang, Xiuyu & Wang, Yingzhou & Zhang, Shude, 2023. "Electrical load forecasting based on variable T-distribution and dual attention mechanism," Energy, Elsevier, vol. 283(C).
    19. Fan, Jingmin & Zhong, Mingwei & Guan, Yuanpeng & Yi, Siqi & Xu, Cancheng & Zhai, Yanpeng & Zhou, Yongwang, 2024. "An online long-term load forecasting method: Hierarchical highway network based on crisscross feature collaboration," Energy, Elsevier, vol. 299(C).
    20. Sun, Yang & Tian, Zhirui, 2025. "Solving few-shot problem in wind speed prediction: A novel transfer strategy based on decomposition and learning ensemble," Applied Energy, Elsevier, vol. 377(PD).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:327:y:2025:i:c:s036054422502033x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.