IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v253y2025ics096014812501328x.html

A pyramidal attention-based transformer model based on improved differential innovation search algorithm and feature extraction for solar radiation prediction considering relevant factors

Author

Listed:
  • Zhang, Xinyu
  • Zhang, Chu
  • He, Rui
  • Ma, Changwen
  • Yao, Junhao
  • Nazir, Muhammad Shahzad
  • Peng, Tian

Abstract

Accurate prediction of solar radiation intensity (SI) is crucial for power system scheduling and site selection of photovoltaic power stations. This paper proposes a multivariable solar radiation prediction model based on Time-varying Filter-based Empirical Mode Decomposition (TVFEMD), Fuzzy Entropy (FE), Random Forest (RF), Triangular Wandering Strategy Improved Differential Creative Search Algorithm (TDCS), and Pyramidal Attention-based Transformer (Pyraformer). First, the Random Forest is used for feature extraction of solar radiation data; then, TVFEMD is employed to break down solar radiation data into constituent sub-modes, thereby mitigating the non-stationarity present in the data sequence. Fuzzy Entropy-based aggregation is utilized to diminish the quantity of data sequences, which, together with various features, forms a multivariable input feature matrix. The Differential Creative Search Algorithm (DCS) is enhanced with a Triangular Wandering Strategy to obtain Improved TDCS, which optimizes the hyperparameters of Pyraformer for solar radiation prediction, thereby enhancing the model's predictive performance. This paper analyzes the prediction metrics of the TDCS-RF-TVFEMD-FE-Pyraformer multivariate model compared with nine other multivariate benchmark models. The results show TVFEMD, FE, and RF boost models accuracy. Post TDCS optimization, Pyraformer's RMSE and MAE outperform the baseline models by 10 %–50 %, with R and SMAPE also outperforming the baseline models.

Suggested Citation

  • Zhang, Xinyu & Zhang, Chu & He, Rui & Ma, Changwen & Yao, Junhao & Nazir, Muhammad Shahzad & Peng, Tian, 2025. "A pyramidal attention-based transformer model based on improved differential innovation search algorithm and feature extraction for solar radiation prediction considering relevant factors," Renewable Energy, Elsevier, vol. 253(C).
    • Handle: RePEc:eee:renene:v:253:y:2025:i:c:s096014812501328x
    DOI: 10.1016/j.renene.2025.123666
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S096014812501328X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2025.123666?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Chen, Jie & Peng, Tian & Qian, Shijie & Ge, Yida & Wang, Zheng & Nazir, Muhammad Shahzad & Zhang, Chu, 2025. "An error-corrected deep Autoformer model via Bayesian optimization algorithm and secondary decomposition for photovoltaic power prediction," Applied Energy, Elsevier, vol. 377(PD).
    2. Wang, Zhenyu & Zhang, Yunpeng & Li, Guorong & Zhang, Jinlong & Zhou, Hai & Wu, Ji, 2024. "A novel solar irradiance forecasting method based on multi-physical process of atmosphere optics and LSTM-BP model," Renewable Energy, Elsevier, vol. 226(C).
    3. Almorox, J. & Benito, M. & Hontoria, C., 2005. "Estimation of monthly Angström–Prescott equation coefficients from measured daily data in Toledo, Spain," Renewable Energy, Elsevier, vol. 30(6), pages 931-936.
    4. Xiong, Jinlin & Peng, Tian & Tao, Zihan & Zhang, Chu & Song, Shihao & Nazir, Muhammad Shahzad, 2023. "A dual-scale deep learning model based on ELM-BiLSTM and improved reptile search algorithm for wind power prediction," Energy, Elsevier, vol. 266(C).
    5. Wang, Yuhan & Zhang, Chu & Fu, Yongyan & Suo, Leiming & Song, Shihao & Peng, Tian & Shahzad Nazir, Muhammad, 2023. "Hybrid solar radiation forecasting model with temporal convolutional network using data decomposition and improved artificial ecosystem-based optimization algorithm," Energy, Elsevier, vol. 280(C).
    6. Wang, Zheng & Peng, Tian & Zhang, Xuedong & Chen, Jialei & Qian, Shijie & Zhang, Chu, 2025. "Enhancing multi-step short-term solar radiation forecasting based on optimized generalized regularized extreme learning machine and multi-scale Gaussian data augmentation technique," Applied Energy, Elsevier, vol. 377(PD).
    7. Vaia I. Kontopoulou & Athanasios D. Panagopoulos & Ioannis Kakkos & George K. Matsopoulos, 2023. "A Review of ARIMA vs. Machine Learning Approaches for Time Series Forecasting in Data Driven Networks," Future Internet, MDPI, vol. 15(8), pages 1-31, July.
    8. Yuan, Feng & Chen, Zhongsheng & Liang, Yujia, 2024. "Precise solar radiation forecasting for sustainable energy integration: A hybrid CEEMD-SCM-GA-LGBM model for day-ahead power and hydrogen production," Renewable Energy, Elsevier, vol. 237(PC).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Song, Shihao & Meng, Anbo & Xiao, Liexi & Tan, Zhenglin & Zou, Pengli & Yin, Hao & Luo, Jianqiang, 2025. "Research on data augmentation and synthetic sample quantity uncertainty in few-shot wind power prediction based on the adaptive CRITIC-HLICRVFL method," Renewable Energy, Elsevier, vol. 252(C).
    2. Tang, Zhongyi & Zhang, Zhirong & Shen, Xianxian & Zhong, Anjie & Nazir, Muhammad Shahzad & Peng, Tian & Zhang, Chu, 2024. "Evolutionary hybrid deep learning based on feature engineering and deep projection encoded echo-state network for lithium batteries state of health estimation," Energy, Elsevier, vol. 313(C).
    3. Krishnan, Naveen & Ravi Kumar, K., 2025. "A novel evolutionary ensemble model to forecast hourly global horizontal irradiance under various climatic zones," Energy, Elsevier, vol. 340(C).
    4. Zhang, Chu & Qiao, Xiujie & Zhang, Zhao & Wang, Yuhan & Fu, Yongyan & Nazir, Muhammad Shahzad & Peng, Tian, 2024. "Simultaneous forecasting of wind speed for multiple stations based on attribute-augmented spatiotemporal graph convolutional network and tree-structured parzen estimator," Energy, Elsevier, vol. 295(C).
    5. Zhang, Chu & Tao, Zihan & Xiong, Jinlin & Qian, Shijie & Fu, Yongyan & Ji, Jie & Nazir, Muhammad Shahzad & Peng, Tian, 2024. "Research and application of a novel weight-based evolutionary ensemble model using principal component analysis for wind power prediction," Renewable Energy, Elsevier, vol. 232(C).
    6. He, Rui & Peng, Tian & Zhang, Xinyu & Chen, Zhigang & Yao, Junhao & Nazir, Muhammad Shahzad & Zhang, Chu, 2026. "A novel hybrid model for state of health prediction in lithium batteries based on non-stationary transformers optimized by tree-structured Parzen estimator considering health factors," Applied Energy, Elsevier, vol. 402(PC).
    7. Makade, Rahul G. & Chakrabarti, Siddharth & Jamil, Basharat & Sakhale, C.N., 2020. "Estimation of global solar radiation for the tropical wet climatic region of India: A theory of experimentation approach," Renewable Energy, Elsevier, vol. 146(C), pages 2044-2059.
    8. Zhang, Zongbin & Huang, Xiaoqiao & Li, Chengli & Cheng, Feiyan & Tai, Yonghang, 2025. "CRAformer: A cross-residual attention transformer for solar irradiation multistep forecasting," Energy, Elsevier, vol. 320(C).
    9. Xilong Lin & Yisen Niu & Zixuan Yan & Lianglin Zou & Ping Tang & Jifeng Song, 2024. "Hybrid Photovoltaic Output Forecasting Model with Temporal Convolutional Network Using Maximal Information Coefficient and White Shark Optimizer," Sustainability, MDPI, vol. 16(14), pages 1-20, July.
    10. Wang, Jianguo & Yuan, Weiru & Zhang, Shude & Cheng, Shun & Han, Lincheng, 2024. "Implementing ultra-short-term wind power forecasting without information leakage through cascade decomposition and attention mechanism," Energy, Elsevier, vol. 312(C).
    11. Qingliang Zhao & Hongding Li & Xiao Liu & Yiduo Wang, 2025. "A Hybrid Model of Multi-Head Attention Enhanced BiLSTM, ARIMA, and XGBoost for Stock Price Forecasting Based on Wavelet Denoising," Mathematics, MDPI, vol. 13(16), pages 1-21, August.
    12. Zang, Haixiang & Li, Wenan & Cheng, Lilin & Liu, Jingxuan & Wei, Zhinong & Sun, Guoqiang, 2025. "Short-term multi-site solar irradiance prediction with dynamic-graph-convolution-based spatial-temporal correlation capturing," Renewable Energy, Elsevier, vol. 246(C).
    13. Wang, Chao & Lin, Hong & Yang, Ming & Fu, Xiaoling & Yuan, Yue & Wang, Zewei, 2024. "A novel chaotic time series wind power point and interval prediction method based on data denoising strategy and improved coati optimization algorithm," Chaos, Solitons & Fractals, Elsevier, vol. 187(C).
    14. Lam, Joseph C. & Wan, Kevin K.W. & Lau, Chris C.S. & Yang, Liu, 2008. "Climatic influences on solar modelling in China," Renewable Energy, Elsevier, vol. 33(7), pages 1591-1604.
    15. Aurelia Rybak & Aleksandra Rybak & Spas D. Kolev, 2023. "Modeling the Photovoltaic Power Generation in Poland in the Light of PEP2040: An Application of Multiple Regression," Energies, MDPI, vol. 16(22), pages 1-17, November.
    16. Meng, Anbo & Zhang, Haitao & Yin, Hao & Xian, Zikang & Chen, Shu & Zhu, Zibin & Zhang, Zheng & Rong, Jiayu & Li, Chen & Wang, Chenen & Wu, Zhenbo & Deng, Weisi & Luo, Jianqiang & Wang, Xiaolin, 2023. "A novel multi-gradient evolutionary deep learning approach for few-shot wind power prediction using time-series GAN," Energy, Elsevier, vol. 283(C).
    17. Gong, Ying & Wang, Yongzheng & Xie, Yuanhang & Peng, Xuzhang & Peng, Yan & Zhang, Wenhua, 2025. "Dynamic fusion LSTM-Transformer for prediction in energy harvesting from human motions," Energy, Elsevier, vol. 327(C).
    18. Shuai Guo & Guiping Peng & Shiheng Chai & Jiwei Jia & Zhenhui Deng & Zhenqian Chen, 2025. "Study on Meta-Learning-Improved Operational Characteristic Model of Central Air-Conditioning Systems," Energies, MDPI, vol. 18(20), pages 1-20, October.
    19. Li, Xuehan & Wang, Wei & Fang, Fang & Liu, Jizhen & Chen, Zhe, 2025. "Improving active power regulation for wind turbine by phase leading cascaded error-based active disturbance rejection control and multi-objective optimization," Renewable Energy, Elsevier, vol. 243(C).
    20. Filipe R. Ramos & Luisa M. Martinez & Luis F. Martinez & Ricardo Abreu & Lihki Rubio, 2025. "Mapping e-commerce trends in the USA: a time series and deep learning approach," Journal of Marketing Analytics, Palgrave Macmillan, vol. 13(3), pages 606-634, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:253:y:2025:i:c:s096014812501328x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.