IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v272y2023ics0360544223005340.html

A 3D ConvLSTM-CNN network based on multi-channel color extraction for ultra-short-term solar irradiance forecasting

Author

Listed:
  • Huang, Xiaoqiao
  • Liu, Jun
  • Xu, Shaozhen
  • Li, Chengli
  • Li, Qiong
  • Tai, Yonghang

Abstract

Due to the intermittency and fluctuation of solar energy, its exponential growth presents serious challenges to the power system. Therefore, photovoltaic (PV) power forecasting, including solar irradiance forecasting, has become a necessary prerequisite for the grid connection of photovoltaic power stations. However, traditional 2D convolution networks are less effective in extracting spatial features, especially limited in handling long-term dependencies. To address these problems, in this paper, a novel ultra-short-term solar irradiance forecasting method based on a 3D Convolutional Long Short-Term Memory and 3D Convolutional Neural Networks (3D ConvLSTM-CNN) hybrid model is proposed by processing multiple consecutive all-sky images with various color channels, the spatial information of different color channel images can better extract different types of cloud information, and the 3D ConvLSTM-CNN can take into account the temporal information. The temporal and spatial features of the sky image are extracted from multiple images at different times, simultaneously, and the textual meteorological features of the corresponding images fused via the LSTM hybrid network input model to finally establish the model for forecasting the next moment. All-sky image data and irradiance data collected by Yunnan Normal University are used to test and verify the model. The experimental results indicate that the proposed method has a promising performance and achieves 28.2%, 34.8%, 19.9%, 42.7%, and 68.3% improvement on nRMSE, MAPE, SMAPE, MedAPE, and R2 over the persistence model for 5-min ahead global horizontal irradiance (GHI) prediction.

Suggested Citation

  • Huang, Xiaoqiao & Liu, Jun & Xu, Shaozhen & Li, Chengli & Li, Qiong & Tai, Yonghang, 2023. "A 3D ConvLSTM-CNN network based on multi-channel color extraction for ultra-short-term solar irradiance forecasting," Energy, Elsevier, vol. 272(C).
  • Handle: RePEc:eee:energy:v:272:y:2023:i:c:s0360544223005340
    DOI: 10.1016/j.energy.2023.127140
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544223005340
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2023.127140?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Chujie Tian & Jian Ma & Chunhong Zhang & Panpan Zhan, 2018. "A Deep Neural Network Model for Short-Term Load Forecast Based on Long Short-Term Memory Network and Convolutional Neural Network," Energies, MDPI, vol. 11(12), pages 1-13, December.
    2. Xiong, Wei & Liu, Zhongbing & Wu, Zhenghong & Wu, Jing & Su, Fanghan & Zhang, Ling, 2022. "Investigation of the effect of Inter-Building Effect on the performance of semi-transparent PV glazing system," Energy, Elsevier, vol. 245(C).
    3. Zang, Haixiang & Liu, Ling & Sun, Li & Cheng, Lilin & Wei, Zhinong & Sun, Guoqiang, 2020. "Short-term global horizontal irradiance forecasting based on a hybrid CNN-LSTM model with spatiotemporal correlations," Renewable Energy, Elsevier, vol. 160(C), pages 26-41.
    4. Huang, Xiaoqiao & Li, Qiong & Tai, Yonghang & Chen, Zaiqing & Liu, Jun & Shi, Junsheng & Liu, Wuming, 2022. "Time series forecasting for hourly photovoltaic power using conditional generative adversarial network and Bi-LSTM," Energy, Elsevier, vol. 246(C).
    5. Wang, Fei & Lu, Xiaoxing & Mei, Shengwei & Su, Ying & Zhen, Zhao & Zou, Zubing & Zhang, Xuemin & Yin, Rui & Duić, Neven & Shafie-khah, Miadreza & Catalão, João P.S., 2022. "A satellite image data based ultra-short-term solar PV power forecasting method considering cloud information from neighboring plant," Energy, Elsevier, vol. 238(PC).
    6. Chu, Yinghao & Li, Mengying & Pedro, Hugo T.C. & Coimbra, Carlos F.M., 2015. "Real-time prediction intervals for intra-hour DNI forecasts," Renewable Energy, Elsevier, vol. 83(C), pages 234-244.
    7. Wang, Xiaoyang & Sun, Yunlin & Luo, Duo & Peng, Jinqing, 2022. "Comparative study of machine learning approaches for predicting short-term photovoltaic power output based on weather type classification," Energy, Elsevier, vol. 240(C).
    8. Feng, Cong & Zhang, Jie & Zhang, Wenqi & Hodge, Bri-Mathias, 2022. "Convolutional neural networks for intra-hour solar forecasting based on sky image sequences," Applied Energy, Elsevier, vol. 310(C).
    9. Ahmed Aljanad & Nadia M. L. Tan & Vassilios G. Agelidis & Hussain Shareef, 2021. "Neural Network Approach for Global Solar Irradiance Prediction at Extremely Short-Time-Intervals Using Particle Swarm Optimization Algorithm," Energies, MDPI, vol. 14(4), pages 1-20, February.
    10. Gao, Bixuan & Huang, Xiaoqiao & Shi, Junsheng & Tai, Yonghang & Zhang, Jun, 2020. "Hourly forecasting of solar irradiance based on CEEMDAN and multi-strategy CNN-LSTM neural networks," Renewable Energy, Elsevier, vol. 162(C), pages 1665-1683.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rubio, José de Jesús & Garcia, Donaldo & Sossa, Humberto & Garcia, Ivan & Zacarias, Alejandro & Mujica-Vargas, Dante, 2023. "Energy processes prediction by a convolutional radial basis function network," Energy, Elsevier, vol. 284(C).
    2. Peña-Cruz, Manuel I. & Díaz-Ponce, Arturo & Sánchez-Segura, César D. & Valentín-Coronado, Luis & Moctezuma, Daniela, 2024. "Short-term forecast of solar irradiance components using an alternative mathematical approach for the identification of cloud features," Renewable Energy, Elsevier, vol. 237(PC).
    3. Dou, Weijing & Wang, Kai & Shan, Shuo & Chen, Mingyu & Zhang, Kanjian & Wei, Haikun & Sreeram, Victor, 2025. "A multi-modal deep clustering method for day-ahead solar irradiance forecasting using ground-based cloud imagery and time series data," Energy, Elsevier, vol. 321(C).
    4. Dou, Weijing & Wang, Kai & Shan, Shuo & Zhang, Kanjian & Wei, Haikun & Sreeram, Victor, 2025. "A hybrid correction framework using disentangled seasonal-trend representations and MoE for NWP solar irradiance forecast," Applied Energy, Elsevier, vol. 397(C).
    5. Xie, Qiyue & Ma, Lin & Liu, Yao & Fu, Qiang & Shen, Zhongli & Wang, Xiaoli, 2023. "An improved SSA-BiLSTM-based short-term irradiance prediction model via sky images feature extraction," Renewable Energy, Elsevier, vol. 219(P2).
    6. Zang, Haixiang & Chen, Dianhao & Liu, Jingxuan & Cheng, Lilin & Sun, Guoqiang & Wei, Zhinong, 2024. "Improving ultra-short-term photovoltaic power forecasting using a novel sky-image-based framework considering spatial-temporal feature interaction," Energy, Elsevier, vol. 293(C).
    7. Han, Tian & Li, Ruimeng & Wang, Xiao & Wang, Ying & Chen, Kang & Peng, Huaiwu & Gao, Zhenxin & Wang, Nannan & Peng, Qinke, 2024. "Intra-hour solar irradiance forecasting using topology data analysis and physics-driven deep learning," Renewable Energy, Elsevier, vol. 224(C).
    8. Chen, Yunxiao & Lin, Chaojing & Zhang, Yilan & Liu, Jinfu & Yu, Daren, 2024. "Proactive failure warning for wind power forecast models based on volatility indicators analysis," Energy, Elsevier, vol. 305(C).
    9. Mirza, Adeel Feroz & Mansoor, Majad & Usman, Muhammad & Ling, Qiang, 2023. "A comprehensive approach for PV wind forecasting by using a hyperparameter tuned GCVCNN-MRNN deep learning model," Energy, Elsevier, vol. 283(C).
    10. Neve, Todd & Shimizu, Makoto & Yugami, Hiroo, 2025. "Direct normal irradiance forecasting for high-temperature concentrated solar thermal systems," Renewable Energy, Elsevier, vol. 255(C).
    11. Liu, Mengcheng & Ling, Qiang, 2025. "Spatial–temporal multimodal fusion model for intra-hour solar power forecasting under variable weather conditions," Renewable Energy, Elsevier, vol. 248(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Liao, Zhouyi & Coimbra, Carlos F.M., 2024. "Hybrid solar irradiance nowcasting and forecasting with the SCOPE method and convolutional neural networks," Renewable Energy, Elsevier, vol. 232(C).
    2. Neethu Elizabeth Michael & Manohar Mishra & Shazia Hasan & Ahmed Al-Durra, 2022. "Short-Term Solar Power Predicting Model Based on Multi-Step CNN Stacked LSTM Technique," Energies, MDPI, vol. 15(6), pages 1-20, March.
    3. Liu, Tianhao & Shan, Linke & Jiang, Meihui & Li, Fangning & Kong, Fannie & Du, Pengcheng & Zhu, Hongyu & Goh, Hui Hwang & Kurniawan, Tonni Agustiono & Huang, Chao & Zhang, Dongdong, 2025. "Multi-dimensional data processing and intelligent forecasting technologies for renewable energy generation," Applied Energy, Elsevier, vol. 398(C).
    4. Zang, Haixiang & Chen, Dianhao & Liu, Jingxuan & Cheng, Lilin & Sun, Guoqiang & Wei, Zhinong, 2024. "Improving ultra-short-term photovoltaic power forecasting using a novel sky-image-based framework considering spatial-temporal feature interaction," Energy, Elsevier, vol. 293(C).
    5. Barancsuk, Lilla & Groma, Veronika & Kocziha, Barnabás, 2025. "Hybrid ultra-short term solar irradiation forecasting using resource-efficient multi-step long-short term memory," Renewable Energy, Elsevier, vol. 247(C).
    6. Xu, Shaozhen & Liu, Jun & Huang, Xiaoqiao & Li, Chengli & Chen, Zaiqing & Tai, Yonghang, 2024. "Minutely multi-step irradiance forecasting based on all-sky images using LSTM-InformerStack hybrid model with dual feature enhancement," Renewable Energy, Elsevier, vol. 224(C).
    7. Sabadus, Andreea & Blaga, Robert & Hategan, Sergiu-Mihai & Calinoiu, Delia & Paulescu, Eugenia & Mares, Oana & Boata, Remus & Stefu, Nicoleta & Paulescu, Marius & Badescu, Viorel, 2024. "A cross-sectional survey of deterministic PV power forecasting: Progress and limitations in current approaches," Renewable Energy, Elsevier, vol. 226(C).
    8. Wang, Zhenyu & Zhang, Yunpeng & Li, Guorong & Zhang, Jinlong & Zhou, Hai & Wu, Ji, 2024. "A novel solar irradiance forecasting method based on multi-physical process of atmosphere optics and LSTM-BP model," Renewable Energy, Elsevier, vol. 226(C).
    9. Nie, Yuhao & Paletta, Quentin & Scott, Andea & Pomares, Luis Martin & Arbod, Guillaume & Sgouridis, Sgouris & Lasenby, Joan & Brandt, Adam, 2024. "Sky image-based solar forecasting using deep learning with heterogeneous multi-location data: Dataset fusion versus transfer learning," Applied Energy, Elsevier, vol. 369(C).
    10. Zheng, Lingwei & Su, Ran & Sun, Xinyu & Guo, Siqi, 2023. "Historical PV-output characteristic extraction based weather-type classification strategy and its forecasting method for the day-ahead prediction of PV output," Energy, Elsevier, vol. 271(C).
    11. Xiao, Zenan & Huang, Xiaoqiao & Liu, Jun & Li, Chengli & Tai, Yonghang, 2023. "A novel method based on time series ensemble model for hourly photovoltaic power prediction," Energy, Elsevier, vol. 276(C).
    12. Nourani, Vahid & Sharghi, Elnaz & Behfar, Nazanin & Zhang, Yongqiang, 2022. "Multi-step-ahead solar irradiance modeling employing multi-frequency deep learning models and climatic data," Applied Energy, Elsevier, vol. 315(C).
    13. Hongchao Zhang & Tengteng Zhu, 2022. "Stacking Model for Photovoltaic-Power-Generation Prediction," Sustainability, MDPI, vol. 14(9), pages 1-16, May.
    14. Isaac Gallardo & Daniel Amor & Álvaro Gutiérrez, 2023. "Recent Trends in Real-Time Photovoltaic Prediction Systems," Energies, MDPI, vol. 16(15), pages 1-17, July.
    15. Abad-Alcaraz, V. & Castilla, M. & Carballo, J.A. & Bonilla, J. & Álvarez, J.D., 2025. "Multimodal deep learning for solar radiation forecasting," Applied Energy, Elsevier, vol. 393(C).
    16. Vu, Ba Hau & Chung, Il-Yop, 2022. "Optimal generation scheduling and operating reserve management for PV generation using RNN-based forecasting models for stand-alone microgrids," Renewable Energy, Elsevier, vol. 195(C), pages 1137-1154.
    17. Wang, Lining & Mao, Mingxuan & Xie, Jili & Liao, Zheng & Zhang, Hao & Li, Huanxin, 2023. "Accurate solar PV power prediction interval method based on frequency-domain decomposition and LSTM model," Energy, Elsevier, vol. 262(PB).
    18. Hong Wu & Haipeng Liu & Huaiping Jin & Yanping He, 2024. "Ultra-Short-Term Photovoltaic Power Prediction by NRGA-BiLSTM Considering Seasonality and Periodicity of Data," Energies, MDPI, vol. 17(18), pages 1-19, September.
    19. Liu, Jingxuan & Zang, Haixiang & Zhang, Fengchun & Cheng, Lilin & Ding, Tao & Wei, Zhinong & Sun, Guoqiang, 2023. "A hybrid meteorological data simulation framework based on time-series generative adversarial network for global daily solar radiation estimation," Renewable Energy, Elsevier, vol. 219(P1).
    20. Huang, Congzhi & Yang, Mengyuan, 2023. "Memory long and short term time series network for ultra-short-term photovoltaic power forecasting," Energy, Elsevier, vol. 279(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:272:y:2023:i:c:s0360544223005340. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.