IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v406y2026ics0306261925020148.html

A physics-informed machine learning method for short-term solar radiation forecast with satellite-derived cloud optical depth

Author

Listed:
  • Peng, Wanshan
  • He, Tao
  • Ma, Yichuan
  • Zheng, Yueming

Abstract

The variation of surface incident solar radiation (i.e., global horizontal irradiance, GHI) challenges the stable integration of solar energy, underscoring the necessity of accurate GHI forecasting. Although advances in machine learning have facilitated GHI forecasting using geostationary satellite observations, most methods remain purely data-driven, relying on historical GHI or its proxy variables (e.g., clearness index) as input, thereby lacking physical constraints and exhibiting poor interpretability. This study proposes a short-term (10-min – 4-h) GHI forecasting method with two steps. First, cloud optical depth (COD) and cloud mask from Geostationary Operational Environmental Satellite-16 (GOES-16) are input into deep learning models to forecast both variables, and the final COD forecasts are obtained by combining their predictions. Second, the forecasted COD, together with auxiliary variables (aerosol optical depth, water vapor, black-sky albedo, and solar zenith angle), is converted into GHI forecasts using an all-sky estimation model developed through radiative transfer simulations. Compared with purely data-driven methods, the proposed hybrid model explicitly accounts for multiple drivers of GHI, thereby enhancing interpretability and enforcing physical constraints. This leads to more reliable decision support, clearer attribution of influencing factors, and a stronger foundation for further model improvement. Within a 4-h lead time, the root mean squared error (RMSE) and mean bias error (MBE) of GHI forecasts ranged from 96.7–150.3 W/m2 and −6.9–0.2 W/m2, respectively. When the model trained on GOES-16 data mainly over the continental U.S. was directly applied to Himawari-8 data over East Asia, validation results indicated an RMSE of 137.0–159.2 W/m2 for GHI forecasts, demonstrating the model's potential for cross-regional applicability. Additionally, incorporating cloud mask predictions mitigates the overprediction of low COD (≤10), reducing MBE of GHI forecasts by 14.0–33.7 W/m2. This study proposes a partly interpretable GHI forecasting method that facilitates solar energy's large-scale and efficient utilization.

Suggested Citation

  • Peng, Wanshan & He, Tao & Ma, Yichuan & Zheng, Yueming, 2026. "A physics-informed machine learning method for short-term solar radiation forecast with satellite-derived cloud optical depth," Applied Energy, Elsevier, vol. 406(C).
  • Handle: RePEc:eee:appene:v:406:y:2026:i:c:s0306261925020148
    DOI: 10.1016/j.apenergy.2025.127284
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925020148
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.127284?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Wang, Lunche & Lu, Yunbo & Wang, Zhitong & Li, Huaping & Zhang, Ming, 2024. "Hourly solar radiation estimation and uncertainty quantification using hybrid models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 202(C).
    2. Kosmopoulos, Panagiotis & Dhake, Harshal & Melita, Nefeli & Tagarakis, Konstantinos & Georgakis, Aggelos & Stefas, Avgoustinos & Vaggelis, Orestis & Korre, Valentina & Kashyap, Yashwant, 2024. "Multi-Layer Cloud Motion Vector Forecasting for Solar Energy Applications," Applied Energy, Elsevier, vol. 353(PB).
    3. Despotovic, Milan & Voyant, Cyril & Garcia-Gutierrez, Luis & Almorox, Javier & Notton, Gilles, 2024. "Solar irradiance time series forecasting using auto-regressive and extreme learning methods: Influence of transfer learning and clustering," Applied Energy, Elsevier, vol. 365(C).
    4. repec:hal:journl:hal-04619484 is not listed on IDEAS
    5. Wen, Haoran & Du, Yang & Chen, Xiaoyang & Lim, Eng Gee & Wen, Huiqing & Yan, Ke, 2023. "A regional solar forecasting approach using generative adversarial networks with solar irradiance maps," Renewable Energy, Elsevier, vol. 216(C).
    6. Voyant, Cyril & Notton, Gilles & Kalogirou, Soteris & Nivet, Marie-Laure & Paoli, Christophe & Motte, Fabrice & Fouilloy, Alexis, 2017. "Machine learning methods for solar radiation forecasting: A review," Renewable Energy, Elsevier, vol. 105(C), pages 569-582.
    7. Nespoli, Alfredo & Niccolai, Alessandro & Ogliari, Emanuele & Perego, Giovanni & Collino, Elena & Ronzio, Dario, 2022. "Machine Learning techniques for solar irradiation nowcasting: Cloud type classification forecast through satellite data and imagery," Applied Energy, Elsevier, vol. 305(C).
    8. Song, Zhe & Cao, Sunliang & Yang, Hongxing, 2024. "An interpretable framework for modeling global solar radiation using tree-based ensemble machine learning and Shapley additive explanations methods," Applied Energy, Elsevier, vol. 364(C).
    9. Li, You & Zhou, Weisheng & Wang, Yafei & Miao, Sheng & Yao, Wanxiang & Gao, Weijun, 2025. "Interpretable deep learning framework for hourly solar radiation forecasting based on decomposing multi-scale variations," Applied Energy, Elsevier, vol. 377(PA).
    10. Suman Ravuri & Karel Lenc & Matthew Willson & Dmitry Kangin & Remi Lam & Piotr Mirowski & Megan Fitzsimons & Maria Athanassiadou & Sheleem Kashem & Sam Madge & Rachel Prudden & Amol Mandhane & Aidan C, 2021. "Skilful precipitation nowcasting using deep generative models of radar," Nature, Nature, vol. 597(7878), pages 672-677, September.
    11. Al-Yahyai, Sultan & Charabi, Yassine & Gastli, Adel, 2010. "Review of the use of Numerical Weather Prediction (NWP) Models for wind energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 14(9), pages 3192-3198, December.
    12. Chu, Yinghao & Wang, Yiling & Yang, Dazhi & Chen, Shanlin & Li, Mengying, 2024. "A review of distributed solar forecasting with remote sensing and deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 198(C).
    13. Xiang, Zheng & He, Tao & Yang, Xin & Ma, Yichuan, 2025. "Universal approach for albedo estimation from multiple fine spatial-resolution satellite data: Preliminary consistency evaluation with Landsat 8, Sentinel-2 and GaoFen-1 albedo data," Applied Energy, Elsevier, vol. 394(C).
    14. Ioannis-Panagiotis Raptis & Stelios Kazadzis & Ilias Fountoulakis & Kyriakoula Papachristopoulou & Dimitra Kouklaki & Basil E. Psiloglou & Andreas Kazantzidis & Charilaos Benetatos & Nikolaos Papadimi, 2023. "Evaluation of the Solar Energy Nowcasting System (SENSE) during a 12-Months Intensive Measurement Campaign in Athens, Greece," Energies, MDPI, vol. 16(14), pages 1-19, July.
    15. Acikgoz, Hakan, 2022. "A novel approach based on integration of convolutional neural networks and deep feature selection for short-term solar radiation forecasting," Applied Energy, Elsevier, vol. 305(C).
    16. Liu, Yongqi & Qin, Hui & Zhang, Zhendong & Pei, Shaoqian & Wang, Chao & Yu, Xiang & Jiang, Zhiqiang & Zhou, Jianzhong, 2019. "Ensemble spatiotemporal forecasting of solar irradiation using variational Bayesian convolutional gate recurrent unit network," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    17. Ruan, Zhaohui & Sun, Weiwei & Yuan, Yuan & Tan, Heping, 2023. "Accurately forecasting solar radiation distribution at both spatial and temporal dimensions simultaneously with fully-convolutional deep neural network model," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    18. Li, Ruohan & Wang, Dongdong & Wang, Zhihao & Liang, Shunlin & Li, Zhanqing & Xie, Yiqun & He, Jiena, 2025. "Transformer approach to nowcasting solar energy using geostationary satellite data," Applied Energy, Elsevier, vol. 377(PA).
    19. Qiangsheng Bu & Shuyi Zhuang & Fei Luo & Zhigang Ye & Yubo Yuan & Tianrui Ma & Tao Da, 2024. "Improving Solar Radiation Forecasting in Cloudy Conditions by Integrating Satellite Observations," Energies, MDPI, vol. 17(24), pages 1-20, December.
    20. Carpentieri, A. & Folini, D. & Nerini, D. & Pulkkinen, S. & Wild, M. & Meyer, A., 2023. "Intraday probabilistic forecasts of surface solar radiation with cloud scale-dependent autoregressive advection," Applied Energy, Elsevier, vol. 351(C).
    21. Pan Xia & Lu Zhang & Min Min & Jun Li & Yun Wang & Yu Yu & Shengjie Jia, 2024. "Accurate nowcasting of cloud cover at solar photovoltaic plants using geostationary satellite images," Nature Communications, Nature, vol. 15(1), pages 1-10, December.
    22. Deo, Ravinesh C. & Wen, Xiaohu & Qi, Feng, 2016. "A wavelet-coupled support vector machine model for forecasting global incident solar radiation using limited meteorological dataset," Applied Energy, Elsevier, vol. 168(C), pages 568-593.
    23. Femke J. M. M. Nijsse & Jean-Francois Mercure & Nadia Ameli & Francesca Larosa & Sumit Kothari & Jamie Rickman & Pim Vercoulen & Hector Pollitt, 2023. "The momentum of the solar energy transition," Nature Communications, Nature, vol. 14(1), pages 1-10, December.
    24. Hassan, Gasser E. & Youssef, M. Elsayed & Mohamed, Zahraa E. & Ali, Mohamed A. & Hanafy, Ahmed A., 2016. "New Temperature-based Models for Predicting Global Solar Radiation," Applied Energy, Elsevier, vol. 179(C), pages 437-450.
    25. Bamisile, Olusola & Acen, Caroline & Cai, Dongsheng & Huang, Qi & Staffell, Iain, 2025. "The environmental factors affecting solar photovoltaic output," Renewable and Sustainable Energy Reviews, Elsevier, vol. 208(C).
    26. Lin, Fan & Zhang, Yao & Wang, Jianxue, 2023. "Recent advances in intra-hour solar forecasting: A review of ground-based sky image methods," International Journal of Forecasting, Elsevier, vol. 39(1), pages 244-265.
    27. Mayer, Martin János & Yang, Dazhi & Szintai, Balázs, 2023. "Comparing global and regional downscaled NWP models for irradiance and photovoltaic power forecasting: ECMWF versus AROME," Applied Energy, Elsevier, vol. 352(C).
    28. Suman, A., 2021. "Role of renewable energy technologies in climate change adaptation and mitigation: A brief review from Nepal," Renewable and Sustainable Energy Reviews, Elsevier, vol. 151(C).
    29. Diagne, Maimouna & David, Mathieu & Lauret, Philippe & Boland, John & Schmutz, Nicolas, 2013. "Review of solar irradiance forecasting methods and a proposition for small-scale insular grids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 27(C), pages 65-76.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Zhijin & Wu, Senzhen & Huang, Yaohui & Liu, Ruyu & Liu, Xiufeng, 2026. "A comprehensive review of deep learning for solar nowcasting: Enhancing accuracy, reliability, and interpretability," Applied Energy, Elsevier, vol. 407(C).
    2. Qiangsheng Bu & Shuyi Zhuang & Fei Luo & Zhigang Ye & Yubo Yuan & Tianrui Ma & Tao Da, 2024. "Improving Solar Radiation Forecasting in Cloudy Conditions by Integrating Satellite Observations," Energies, MDPI, vol. 17(24), pages 1-20, December.
    3. Carpentieri, A. & Folini, D. & Leinonen, J. & Meyer, A., 2025. "Extending intraday solar forecast horizons with deep generative models," Applied Energy, Elsevier, vol. 377(PA).
    4. Li, Ruohan & Wang, Dongdong & Wang, Zhihao & Liang, Shunlin & Li, Zhanqing & Xie, Yiqun & He, Jiena, 2025. "Transformer approach to nowcasting solar energy using geostationary satellite data," Applied Energy, Elsevier, vol. 377(PA).
    5. Ping-Huan Kuo & Chiou-Jye Huang, 2018. "A Green Energy Application in Energy Management Systems by an Artificial Intelligence-Based Solar Radiation Forecasting Model," Energies, MDPI, vol. 11(4), pages 1-15, April.
    6. Ruan, Guoping & Chen, Xiaoyang & Li, Yiheng & Lim, Eng Gee & Fang, Lurui & Jiang, Lin & Du, Yang & Wang, Fei, 2026. "SkyNet: A Deep Learning Architecture for Intra-hour Multimodal Solar Forecasting with Ground-based Sky Images," Renewable Energy, Elsevier, vol. 256(PF).
    7. Feng, Yu & Hao, Weiping & Li, Haoru & Cui, Ningbo & Gong, Daozhi & Gao, Lili, 2020. "Machine learning models to quantify and map daily global solar radiation and photovoltaic power," Renewable and Sustainable Energy Reviews, Elsevier, vol. 118(C).
    8. Anh Ngoc-Lan Huynh & Ravinesh C. Deo & Duc-Anh An-Vo & Mumtaz Ali & Nawin Raj & Shahab Abdulla, 2020. "Near Real-Time Global Solar Radiation Forecasting at Multiple Time-Step Horizons Using the Long Short-Term Memory Network," Energies, MDPI, vol. 13(14), pages 1-30, July.
    9. Dou, Weijing & Wang, Kai & Shan, Shuo & Zhang, Kanjian & Wei, Haikun & Sreeram, Victor, 2025. "A hybrid correction framework using disentangled seasonal-trend representations and MoE for NWP solar irradiance forecast," Applied Energy, Elsevier, vol. 397(C).
    10. Chu, Yinghao & Wang, Yiling & Yang, Dazhi & Chen, Shanlin & Li, Mengying, 2024. "A review of distributed solar forecasting with remote sensing and deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 198(C).
    11. Lan, Hai & Yin, He & Hong, Ying-Yi & Wen, Shuli & Yu, David C. & Cheng, Peng, 2018. "Day-ahead spatio-temporal forecasting of solar irradiation along a navigation route," Applied Energy, Elsevier, vol. 211(C), pages 15-27.
    12. Demirhan, Haydar & Renwick, Zoe, 2018. "Missing value imputation for short to mid-term horizontal solar irradiance data," Applied Energy, Elsevier, vol. 225(C), pages 998-1012.
    13. Voyant, Cyril & Motte, Fabrice & Notton, Gilles & Fouilloy, Alexis & Nivet, Marie-Laure & Duchaud, Jean-Laurent, 2018. "Prediction intervals for global solar irradiation forecasting using regression trees methods," Renewable Energy, Elsevier, vol. 126(C), pages 332-340.
    14. Wang, Zhenyu & Zhang, Yunpeng & Li, Guorong & Zhang, Jinlong & Zhou, Hai & Wu, Ji, 2024. "A novel solar irradiance forecasting method based on multi-physical process of atmosphere optics and LSTM-BP model," Renewable Energy, Elsevier, vol. 226(C).
    15. Fernando Venâncio Mucomole & Carlos Augusto Santos Silva & Lourenço Lázaro Magaia, 2025. "Parametric Forecast of Solar Energy over Time by Applying Machine Learning Techniques: Systematic Review," Energies, MDPI, vol. 18(6), pages 1-51, March.
    16. Gao, Yuan & Hu, Zehuan & Chen, Wei-An & Liu, Mingzhe & Ruan, Yingjun, 2025. "A revolutionary neural network architecture with interpretability and flexibility based on Kolmogorov–Arnold for solar radiation and temperature forecasting," Applied Energy, Elsevier, vol. 378(PA).
    17. Zang, Haixiang & Li, Wenan & Cheng, Lilin & Liu, Jingxuan & Wei, Zhinong & Sun, Guoqiang, 2025. "Short-term multi-site solar irradiance prediction with dynamic-graph-convolution-based spatial-temporal correlation capturing," Renewable Energy, Elsevier, vol. 246(C).
    18. Elsinga, Boudewijn & van Sark, Wilfried G.J.H.M., 2017. "Short-term peer-to-peer solar forecasting in a network of photovoltaic systems," Applied Energy, Elsevier, vol. 206(C), pages 1464-1483.
    19. Yang, Yanru & Liu, Yu & Zhang, Yihang & Shu, Shaolong & Zheng, Junsheng, 2025. "DEST-GNN: A double-explored spatio-temporal graph neural network for multi-site intra-hour PV power forecasting," Applied Energy, Elsevier, vol. 378(PA).
    20. Àlex Alonso & Jordi de la Hoz & Helena Martín & Sergio Coronas & Pep Salas & José Matas, 2020. "A Comprehensive Model for the Design of a Microgrid under Regulatory Constraints Using Synthetical Data Generation and Stochastic Optimization," Energies, MDPI, vol. 13(21), pages 1-26, October.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:406:y:2026:i:c:s0306261925020148. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.