IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v232y2024ics0960148124011236.html
   My bibliography  Save this article

Hybrid solar irradiance nowcasting and forecasting with the SCOPE method and convolutional neural networks

Author

Listed:
  • Liao, Zhouyi
  • Coimbra, Carlos F.M.

Abstract

We use a full year (2018) of GOES-R satellite data to produce 5-minute resolved information on cloud coverage for 7 Surface Radiation Budget Network (SURFRAD). The remote sensing images are then processed using the Spectral Cloud Optical Property Estimation (SCOPE) method in conjunction with Convolution Neural Networks (CNNs) for nowcasts and 1-hour ahead forecasts. We propose and compare two CNN based models for GHI now-casting with a 1-hour forecast horizon and a time resolution that processes data every 5 minutes: one enhanced with the SCOPE method for cloud estimation and another without it. The inclusion of SCOPE-derived information significantly improves model performance, yielding an average RMSE of 44.7 versus 68.9 W/m2 for the model without SCOPE information. The present work underscores the efficacy of even basic CNNs in interpreting satellite imagery combined with atmospheric models of the atmosphere to estimate ground irradiance accurately. The hybrid SCOPE-CNN model outperforms the basic CNN model that relies solely on 10 longwave channels, indicating the relevance of SCOPE’s physical features in enhancing predictions across various solar micro-climates. Further advancements using Convolutional Long Short-Time Memory (ConvLSTM) schemes lead to the development of a SCOPE-CNN-ConvLSTM model, showcasing significant enhancements over smart persistence across all conditions.

Suggested Citation

  • Liao, Zhouyi & Coimbra, Carlos F.M., 2024. "Hybrid solar irradiance nowcasting and forecasting with the SCOPE method and convolutional neural networks," Renewable Energy, Elsevier, vol. 232(C).
    • Handle: RePEc:eee:renene:v:232:y:2024:i:c:s0960148124011236
    DOI: 10.1016/j.renene.2024.121055
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148124011236
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2024.121055?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Bai & Yang, Dazhi & Mayer, Martin János & Coimbra, Carlos F.M. & Kleissl, Jan & Kay, Merlinde & Wang, Wenting & Bright, Jamie M. & Xia, Xiang’ao & Lv, Xin & Srinivasan, Dipti & Wu, Yan & Beyer, H, 2023. "Predictability and forecast skill of solar irradiance over the contiguous United States," Renewable and Sustainable Energy Reviews, Elsevier, vol. 182(C).
    2. Huva, Robert & Verbois, Hadrien & Walsh, Wilfred, 2020. "Comparisons of next-day solar forecasting for Singapore using 3DVAR and 4DVAR data assimilation approaches with the WRF model," Renewable Energy, Elsevier, vol. 147(P1), pages 663-671.
    3. Lopes, Francis M. & Conceição, Ricardo & Silva, Hugo G. & Salgado, Rui & Collares-Pereira, Manuel, 2021. "Improved ECMWF forecasts of direct normal irradiance: A tool for better operational strategies in concentrating solar power plants," Renewable Energy, Elsevier, vol. 163(C), pages 755-771.
    4. Huang, Xiaoqiao & Li, Qiong & Tai, Yonghang & Chen, Zaiqing & Zhang, Jun & Shi, Junsheng & Gao, Bixuan & Liu, Wuming, 2021. "Hybrid deep neural model for hourly solar irradiance forecasting," Renewable Energy, Elsevier, vol. 171(C), pages 1041-1060.
    5. Gao, Bixuan & Huang, Xiaoqiao & Shi, Junsheng & Tai, Yonghang & Zhang, Jun, 2020. "Hourly forecasting of solar irradiance based on CEEMDAN and multi-strategy CNN-LSTM neural networks," Renewable Energy, Elsevier, vol. 162(C), pages 1665-1683.
    6. Kaur, Amanpreet & Nonnenmacher, Lukas & Pedro, Hugo T.C. & Coimbra, Carlos F.M., 2016. "Benefits of solar forecasting for energy imbalance markets," Renewable Energy, Elsevier, vol. 86(C), pages 819-830.
    7. Chu, Yinghao & Li, Mengying & Coimbra, Carlos F.M., 2016. "Sun-tracking imaging system for intra-hour DNI forecasts," Renewable Energy, Elsevier, vol. 96(PA), pages 792-799.
    8. Cheng, Hsu-Yung & Yu, Chih-Chang & Lin, Chih-Lung, 2021. "Day-ahead to week-ahead solar irradiance prediction using convolutional long short-term memory networks," Renewable Energy, Elsevier, vol. 179(C), pages 2300-2308.
    9. Zang, Haixiang & Liu, Ling & Sun, Li & Cheng, Lilin & Wei, Zhinong & Sun, Guoqiang, 2020. "Short-term global horizontal irradiance forecasting based on a hybrid CNN-LSTM model with spatiotemporal correlations," Renewable Energy, Elsevier, vol. 160(C), pages 26-41.
    10. Li, Mengying & Chu, Yinghao & Pedro, Hugo T.C. & Coimbra, Carlos F.M., 2016. "Quantitative evaluation of the impact of cloud transmittance and cloud velocity on the accuracy of short-term DNI forecasts," Renewable Energy, Elsevier, vol. 86(C), pages 1362-1371.
    11. Chu, Yinghao & Li, Mengying & Pedro, Hugo T.C. & Coimbra, Carlos F.M., 2015. "Real-time prediction intervals for intra-hour DNI forecasts," Renewable Energy, Elsevier, vol. 83(C), pages 234-244.
    12. Feng, Cong & Zhang, Jie & Zhang, Wenqi & Hodge, Bri-Mathias, 2022. "Convolutional neural networks for intra-hour solar forecasting based on sky image sequences," Applied Energy, Elsevier, vol. 310(C).
    13. Agga, Ali & Abbou, Ahmed & Labbadi, Moussa & El Houm, Yassine, 2021. "Short-term self consumption PV plant power production forecasts based on hybrid CNN-LSTM, ConvLSTM models," Renewable Energy, Elsevier, vol. 177(C), pages 101-112.
    14. Dong, Jin & Olama, Mohammed M. & Kuruganti, Teja & Melin, Alexander M. & Djouadi, Seddik M. & Zhang, Yichen & Xue, Yaosuo, 2020. "Novel stochastic methods to predict short-term solar radiation and photovoltaic power," Renewable Energy, Elsevier, vol. 145(C), pages 333-346.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xu, Shaozhen & Liu, Jun & Huang, Xiaoqiao & Li, Chengli & Chen, Zaiqing & Tai, Yonghang, 2024. "Minutely multi-step irradiance forecasting based on all-sky images using LSTM-InformerStack hybrid model with dual feature enhancement," Renewable Energy, Elsevier, vol. 224(C).
    2. Acikgoz, Hakan, 2022. "A novel approach based on integration of convolutional neural networks and deep feature selection for short-term solar radiation forecasting," Applied Energy, Elsevier, vol. 305(C).
    3. Huang, Xiaoqiao & Liu, Jun & Xu, Shaozhen & Li, Chengli & Li, Qiong & Tai, Yonghang, 2023. "A 3D ConvLSTM-CNN network based on multi-channel color extraction for ultra-short-term solar irradiance forecasting," Energy, Elsevier, vol. 272(C).
    4. Chen, Shanlin & Li, Mengying, 2022. "Improved turbidity estimation from local meteorological data for solar resourcing and forecasting applications," Renewable Energy, Elsevier, vol. 189(C), pages 259-272.
    5. Chu, Yinghao & Li, Mengying & Pedro, Hugo T.C. & Coimbra, Carlos F.M., 2022. "A network of sky imagers for spatial solar irradiance assessment," Renewable Energy, Elsevier, vol. 187(C), pages 1009-1019.
    6. Rodríguez, Fermín & Galarza, Ainhoa & Vasquez, Juan C. & Guerrero, Josep M., 2022. "Using deep learning and meteorological parameters to forecast the photovoltaic generators intra-hour output power interval for smart grid control," Energy, Elsevier, vol. 239(PB).
    7. Elizabeth Michael, Neethu & Hasan, Shazia & Al-Durra, Ahmed & Mishra, Manohar, 2022. "Short-term solar irradiance forecasting based on a novel Bayesian optimized deep Long Short-Term Memory neural network," Applied Energy, Elsevier, vol. 324(C).
    8. Jiang, Chengcheng & Zhu, Qunzhi, 2023. "Evaluating the most significant input parameters for forecasting global solar radiation of different sequences based on Informer," Applied Energy, Elsevier, vol. 348(C).
    9. Nie, Yuhao & Li, Xiatong & Paletta, Quentin & Aragon, Max & Scott, Andea & Brandt, Adam, 2024. "Open-source sky image datasets for solar forecasting with deep learning: A comprehensive survey," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    10. Neethu Elizabeth Michael & Manohar Mishra & Shazia Hasan & Ahmed Al-Durra, 2022. "Short-Term Solar Power Predicting Model Based on Multi-Step CNN Stacked LSTM Technique," Energies, MDPI, vol. 15(6), pages 1-20, March.
    11. Zhao, He & Huang, Xiaoqiao & Xiao, Zenan & Shi, Haoyuan & Li, Chengli & Tai, Yonghang, 2024. "Week-ahead hourly solar irradiation forecasting method based on ICEEMDAN and TimesNet networks," Renewable Energy, Elsevier, vol. 220(C).
    12. Niu, Yinsen & Song, Jifeng & Zou, Lianglin & Yan, Zixuan & Lin, Xilong, 2024. "Cloud detection method using ground-based sky images based on clear sky library and superpixel local threshold," Renewable Energy, Elsevier, vol. 226(C).
    13. Lin, Fan & Zhang, Yao & Wang, Jianxue, 2023. "Recent advances in intra-hour solar forecasting: A review of ground-based sky image methods," International Journal of Forecasting, Elsevier, vol. 39(1), pages 244-265.
    14. Niu, Tong & Li, Jinkai & Wei, Wei & Yue, Hui, 2022. "A hybrid deep learning framework integrating feature selection and transfer learning for multi-step global horizontal irradiation forecasting," Applied Energy, Elsevier, vol. 326(C).
    15. Benali, L. & Notton, G. & Fouilloy, A. & Voyant, C. & Dizene, R., 2019. "Solar radiation forecasting using artificial neural network and random forest methods: Application to normal beam, horizontal diffuse and global components," Renewable Energy, Elsevier, vol. 132(C), pages 871-884.
    16. Hanif, M.F. & Mi, J., 2024. "Harnessing AI for solar energy: Emergence of transformer models," Applied Energy, Elsevier, vol. 369(C).
    17. Chu, Yinghao & Wang, Yiling & Yang, Dazhi & Chen, Shanlin & Li, Mengying, 2024. "A review of distributed solar forecasting with remote sensing and deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 198(C).
    18. Chu, Yinghao & Coimbra, Carlos F.M., 2017. "Short-term probabilistic forecasts for Direct Normal Irradiance," Renewable Energy, Elsevier, vol. 101(C), pages 526-536.
    19. Hongchao Zhang & Tengteng Zhu, 2022. "Stacking Model for Photovoltaic-Power-Generation Prediction," Sustainability, MDPI, vol. 14(9), pages 1-16, May.
    20. Paletta, Quentin & Arbod, Guillaume & Lasenby, Joan, 2023. "Omnivision forecasting: Combining satellite and sky images for improved deterministic and probabilistic intra-hour solar energy predictions," Applied Energy, Elsevier, vol. 336(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:232:y:2024:i:c:s0960148124011236. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.