IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v198y2022icp960-972.html
   My bibliography  Save this article

Evaluation of opaque deep-learning solar power forecast models towards power-grid applications

Author

Listed:
  • Cheng, Lilin
  • Zang, Haixiang
  • Wei, Zhinong
  • Zhang, Fengchun
  • Sun, Guoqiang

Abstract

Solar photovoltaic power plays a vital role in global renewable energy power generation, and an accurate solar power forecast can further promote applications in integrated power systems. Due to advanced artificial intelligence technologies, various deep-learning models have been developed with the benefits of improved prediction precision, but these models inevitably sacrifice their interpretability compared to linear methods. Since a 100% accurate forecast is impossible to achieve, an opaque black-box model will always raise doubts for the operators of renewable power-grids, especially when the prediction deviation may produce higher economic costs and even a system turbulence. Motivated by this, the present study summarizes the requirements of deep-learning solar power forecast models from the power-grid application perspective. Post-hoc evaluation and discussion are conducted to analyze the performances of a typical deep-learning benchmark model based on open-access dataset for solar forecasting. Based on the results, the aim of this study is to increase confidence of deep-learning-based intelligent models into the practical engineering utilization of solar power forecasting. The case studies indicate that some simple evaluation procedures can aid a better understanding of the factors that influence the performances of opaque models, and these procedures can help in the design methods for model modifications.

Suggested Citation

  • Cheng, Lilin & Zang, Haixiang & Wei, Zhinong & Zhang, Fengchun & Sun, Guoqiang, 2022. "Evaluation of opaque deep-learning solar power forecast models towards power-grid applications," Renewable Energy, Elsevier, vol. 198(C), pages 960-972.
    • Handle: RePEc:eee:renene:v:198:y:2022:i:c:p:960-972
    DOI: 10.1016/j.renene.2022.08.054
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148122012204
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.renene.2022.08.054?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Ahmed, R. & Sreeram, V. & Mishra, Y. & Arif, M.D., 2020. "A review and evaluation of the state-of-the-art in PV solar power forecasting: Techniques and optimization," Renewable and Sustainable Energy Reviews, Elsevier, vol. 124(C).
    2. Quan, Hao & Srinivasan, Dipti & Khosravi, Abbas, 2016. "Integration of renewable generation uncertainties into stochastic unit commitment considering reserve and risk: A comparative study," Energy, Elsevier, vol. 103(C), pages 735-745.
    3. Appino, Riccardo Remo & González Ordiano, Jorge Ángel & Mikut, Ralf & Faulwasser, Timm & Hagenmeyer, Veit, 2018. "On the use of probabilistic forecasts in scheduling of renewable energy sources coupled to storages," Applied Energy, Elsevier, vol. 210(C), pages 1207-1218.
    4. Zang, Haixiang & Xu, Ruiqi & Cheng, Lilin & Ding, Tao & Liu, Ling & Wei, Zhinong & Sun, Guoqiang, 2021. "Residential load forecasting based on LSTM fusing self-attention mechanism with pooling," Energy, Elsevier, vol. 229(C).
    5. Giovanni Brusco & Alessandro Burgio & Daniele Menniti & Anna Pinnarelli & Nicola Sorrentino & Pasquale Vizza, 2017. "Quantification of Forecast Error Costs of Photovoltaic Prosumers in Italy," Energies, MDPI, vol. 10(11), pages 1-17, November.
    6. Ahmed, Adil & Khalid, Muhammad, 2019. "A review on the selected applications of forecasting models in renewable power systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 100(C), pages 9-21.
    7. Gao, Bixuan & Huang, Xiaoqiao & Shi, Junsheng & Tai, Yonghang & Zhang, Jun, 2020. "Hourly forecasting of solar irradiance based on CEEMDAN and multi-strategy CNN-LSTM neural networks," Renewable Energy, Elsevier, vol. 162(C), pages 1665-1683.
    8. Moreira, M.O. & Balestrassi, P.P. & Paiva, A.P. & Ribeiro, P.F. & Bonatto, B.D., 2021. "Design of experiments using artificial neural network ensemble for photovoltaic generation forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    9. Kaur, Amanpreet & Nonnenmacher, Lukas & Pedro, Hugo T.C. & Coimbra, Carlos F.M., 2016. "Benefits of solar forecasting for energy imbalance markets," Renewable Energy, Elsevier, vol. 86(C), pages 819-830.
    10. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    11. González-Sopeña, J.M. & Pakrashi, V. & Ghosh, B., 2021. "An overview of performance evaluation metrics for short-term statistical wind power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 138(C).
    12. Goodarzi, Shadi & Perera, H. Niles & Bunn, Derek, 2019. "The impact of renewable energy forecast errors on imbalance volumes and electricity spot prices," Energy Policy, Elsevier, vol. 134(C).
    13. Wen, Lulu & Zhou, Kaile & Yang, Shanlin & Lu, Xinhui, 2019. "Optimal load dispatch of community microgrid with deep learning based solar power and load forecasting," Energy, Elsevier, vol. 171(C), pages 1053-1065.
    14. Peng, Tian & Zhang, Chu & Zhou, Jianzhong & Nazir, Muhammad Shahzad, 2021. "An integrated framework of Bi-directional long-short term memory (BiLSTM) based on sine cosine algorithm for hourly solar radiation forecasting," Energy, Elsevier, vol. 221(C).
    15. Kong, Weicong & Jia, Youwei & Dong, Zhao Yang & Meng, Ke & Chai, Songjian, 2020. "Hybrid approaches based on deep whole-sky-image learning to photovoltaic generation forecasting," Applied Energy, Elsevier, vol. 280(C).
    16. Lima, Marcello Anderson F.B. & Carvalho, Paulo C.M. & Fernández-Ramírez, Luis M. & Braga, Arthur P.S., 2020. "Improving solar forecasting using Deep Learning and Portfolio Theory integration," Energy, Elsevier, vol. 195(C).
    17. Dewangan, Chaman Lal & Singh, S.N. & Chakrabarti, S., 2020. "Combining forecasts of day-ahead solar power," Energy, Elsevier, vol. 202(C).
    18. Markovics, Dávid & Mayer, Martin János, 2022. "Comparison of machine learning methods for photovoltaic power forecasting based on numerical weather prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 161(C).
    19. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda, 2019. "A comparison of day-ahead photovoltaic power forecasting models based on deep learning neural network," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    20. Tawn, R. & Browell, J., 2022. "A review of very short-term wind and solar power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 153(C).
    21. Luo, Xing & Zhang, Dongxiao & Zhu, Xu, 2021. "Deep learning based forecasting of photovoltaic power generation by incorporating domain knowledge," Energy, Elsevier, vol. 225(C).
    22. Ming, Bo & Liu, Pan & Guo, Shenglian & Cheng, Lei & Zhou, Yanlai & Gao, Shida & Li, He, 2018. "Robust hydroelectric unit commitment considering integration of large-scale photovoltaic power: A case study in China," Applied Energy, Elsevier, vol. 228(C), pages 1341-1352.
    23. Narvaez, Gabriel & Giraldo, Luis Felipe & Bressan, Michael & Pantoja, Andres, 2021. "Machine learning for site-adaptation and solar radiation forecasting," Renewable Energy, Elsevier, vol. 167(C), pages 333-342.
    24. Li, Pengtao & Zhou, Kaile & Lu, Xinhui & Yang, Shanlin, 2020. "A hybrid deep learning model for short-term PV power forecasting," Applied Energy, Elsevier, vol. 259(C).
    25. Reikard, Gordon & Hansen, Clifford, 2019. "Forecasting solar irradiance at short horizons: Frequency and time domain models," Renewable Energy, Elsevier, vol. 135(C), pages 1270-1290.
    26. Nonnenmacher, Lukas & Kaur, Amanpreet & Coimbra, Carlos F.M., 2016. "Day-ahead resource forecasting for concentrated solar power integration," Renewable Energy, Elsevier, vol. 86(C), pages 866-876.
    27. Moslehi, Salim & Reddy, T. Agami & Katipamula, Srinivas, 2018. "Evaluation of data-driven models for predicting solar photovoltaics power output," Energy, Elsevier, vol. 142(C), pages 1057-1065.
    28. Alonso-Suárez, R. & David, M. & Branco, V. & Lauret, P., 2020. "Intra-day solar probabilistic forecasts including local short-term variability and satellite information," Renewable Energy, Elsevier, vol. 158(C), pages 554-573.
    29. Liu, Da & Sun, Kun, 2019. "Random forest solar power forecast based on classification optimization," Energy, Elsevier, vol. 187(C).
    30. Sharadga, Hussein & Hajimirza, Shima & Balog, Robert S., 2020. "Time series forecasting of solar power generation for large-scale photovoltaic plants," Renewable Energy, Elsevier, vol. 150(C), pages 797-807.
    31. Ruhnau, Oliver & Hennig, Patrick & Madlener, Reinhard, 2020. "Economic implications of forecasting electricity generation from variable renewable energy sources," Renewable Energy, Elsevier, vol. 161(C), pages 1318-1327.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Liu, Jingxuan & Zang, Haixiang & Ding, Tao & Cheng, Lilin & Wei, Zhinong & Sun, Guoqiang, 2023. "Harvesting spatiotemporal correlation from sky image sequence to improve ultra-short-term solar irradiance forecasting," Renewable Energy, Elsevier, vol. 209(C), pages 619-631.
    2. Moradzadeh, Arash & Moayyed, Hamed & Mohammadi-Ivatloo, Behnam & Vale, Zita & Ramos, Carlos & Ghorbani, Reza, 2023. "A novel cyber-Resilient solar power forecasting model based on secure federated deep learning and data visualization," Renewable Energy, Elsevier, vol. 211(C), pages 697-705.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Jianzhou & Zhou, Yilin & Li, Zhiwu, 2022. "Hour-ahead photovoltaic generation forecasting method based on machine learning and multi objective optimization algorithm," Applied Energy, Elsevier, vol. 312(C).
    2. Hongchao Zhang & Tengteng Zhu, 2022. "Stacking Model for Photovoltaic-Power-Generation Prediction," Sustainability, MDPI, vol. 14(9), pages 1-16, May.
    3. Sarmas, Elissaios & Spiliotis, Evangelos & Stamatopoulos, Efstathios & Marinakis, Vangelis & Doukas, Haris, 2023. "Short-term photovoltaic power forecasting using meta-learning and numerical weather prediction independent Long Short-Term Memory models," Renewable Energy, Elsevier, vol. 216(C).
    4. Xiao, Zenan & Huang, Xiaoqiao & Liu, Jun & Li, Chengli & Tai, Yonghang, 2023. "A novel method based on time series ensemble model for hourly photovoltaic power prediction," Energy, Elsevier, vol. 276(C).
    5. Wang, Xiaoyang & Sun, Yunlin & Luo, Duo & Peng, Jinqing, 2022. "Comparative study of machine learning approaches for predicting short-term photovoltaic power output based on weather type classification," Energy, Elsevier, vol. 240(C).
    6. Zhao, Wei & Zhang, Haoran & Zheng, Jianqin & Dai, Yuanhao & Huang, Liqiao & Shang, Wenlong & Liang, Yongtu, 2021. "A point prediction method based automatic machine learning for day-ahead power output of multi-region photovoltaic plants," Energy, Elsevier, vol. 223(C).
    7. du Plessis, A.A. & Strauss, J.M. & Rix, A.J., 2021. "Short-term solar power forecasting: Investigating the ability of deep learning models to capture low-level utility-scale Photovoltaic system behaviour," Applied Energy, Elsevier, vol. 285(C).
    8. Mohammad Mahdi Forootan & Iman Larki & Rahim Zahedi & Abolfazl Ahmadi, 2022. "Machine Learning and Deep Learning in Energy Systems: A Review," Sustainability, MDPI, vol. 14(8), pages 1-49, April.
    9. Ahmad, Tanveer & Zhang, Dongdong & Huang, Chao, 2021. "Methodological framework for short-and medium-term energy, solar and wind power forecasting with stochastic-based machine learning approach to monetary and energy policy applications," Energy, Elsevier, vol. 231(C).
    10. Korkmaz, Deniz, 2021. "SolarNet: A hybrid reliable model based on convolutional neural network and variational mode decomposition for hourly photovoltaic power forecasting," Applied Energy, Elsevier, vol. 300(C).
    11. Bowen Zhou & Xinyu Chen & Guangdi Li & Peng Gu & Jing Huang & Bo Yang, 2023. "XGBoost–SFS and Double Nested Stacking Ensemble Model for Photovoltaic Power Forecasting under Variable Weather Conditions," Sustainability, MDPI, vol. 15(17), pages 1-24, September.
    12. Chen, Xiaoyang & Du, Yang & Lim, Enggee & Fang, Lurui & Yan, Ke, 2022. "Towards the applicability of solar nowcasting: A practice on predictive PV power ramp-rate control," Renewable Energy, Elsevier, vol. 195(C), pages 147-166.
    13. Qu, Jiaqi & Qian, Zheng & Pei, Yan, 2021. "Day-ahead hourly photovoltaic power forecasting using attention-based CNN-LSTM neural network embedded with multiple relevant and target variables prediction pattern," Energy, Elsevier, vol. 232(C).
    14. Muhammad Naveed Akhter & Saad Mekhilef & Hazlie Mokhlis & Ziyad M. Almohaimeed & Munir Azam Muhammad & Anis Salwa Mohd Khairuddin & Rizwan Akram & Muhammad Majid Hussain, 2022. "An Hour-Ahead PV Power Forecasting Method Based on an RNN-LSTM Model for Three Different PV Plants," Energies, MDPI, vol. 15(6), pages 1-21, March.
    15. Chen, Xiang & Ding, Kun & Zhang, Jingwei & Han, Wei & Liu, Yongjie & Yang, Zenan & Weng, Shuai, 2022. "Online prediction of ultra-short-term photovoltaic power using chaotic characteristic analysis, improved PSO and KELM," Energy, Elsevier, vol. 248(C).
    16. Huang, Xiaoqiao & Li, Qiong & Tai, Yonghang & Chen, Zaiqing & Zhang, Jun & Shi, Junsheng & Gao, Bixuan & Liu, Wuming, 2021. "Hybrid deep neural model for hourly solar irradiance forecasting," Renewable Energy, Elsevier, vol. 171(C), pages 1041-1060.
    17. Rial A. Rajagukguk & Raden A. A. Ramadhan & Hyun-Jin Lee, 2020. "A Review on Deep Learning Models for Forecasting Time Series Data of Solar Irradiance and Photovoltaic Power," Energies, MDPI, vol. 13(24), pages 1-23, December.
    18. Zheng, Lingwei & Su, Ran & Sun, Xinyu & Guo, Siqi, 2023. "Historical PV-output characteristic extraction based weather-type classification strategy and its forecasting method for the day-ahead prediction of PV output," Energy, Elsevier, vol. 271(C).
    19. Paletta, Quentin & Arbod, Guillaume & Lasenby, Joan, 2023. "Omnivision forecasting: Combining satellite and sky images for improved deterministic and probabilistic intra-hour solar energy predictions," Applied Energy, Elsevier, vol. 336(C).
    20. Lu, Renzhi & Bai, Ruichang & Ding, Yuemin & Wei, Min & Jiang, Junhui & Sun, Mingyang & Xiao, Feng & Zhang, Hai-Tao, 2021. "A hybrid deep learning-based online energy management scheme for industrial microgrid," Applied Energy, Elsevier, vol. 304(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:198:y:2022:i:c:p:960-972. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.