IDEAS home Printed from https://ideas.repec.org/a/spr/waterr/v38y2024i7d10.1007_s11269-024-03779-y.html
   My bibliography  Save this article

Real-Time Evaluation of the Uncertainty in Weather Forecasts Through Machine Learning-Based Models

Author

Listed:
  • Carmen Calvo-Olivera

    (SCAYLE)

  • Ángel Manuel Guerrero-Higueras

    (Universidad León)

  • Jesús Lorenzana

    (SCAYLE)

  • Eduardo García-Ortega

    (Universidad León)

Abstract

Meteorological events have always been of great interest because they have influenced everyday activities in critical areas, such as water resource management systems. Weather forecasts are solved with numerical weather prediction models. However, it sometimes leads to unsatisfactory performance due to the inappropriate setting of the initial state. Precipitation forecasting is essential for water resource management in semi-arid climate and seasonal rainfall areas such as the Ebro basin. This research aims to improve the estimation of the uncertainty associated with real-time precipitation predictions presenting a machine learning-based method to evaluate the uncertainty of a weather forecast obtained by the Weather Research and Forecasting model. We use a model trained with ground-truth data from the Confederación Hidrográfica del Ebro, and WRF forecast results to compute uncertainty. Experimental results show that Decision Tree-based ensemble methods get the lowest generalization error. Prediction models studied have above 90% accuracy, and root mean square error has similar results compared to those obtained with the ground truth data. Random Forest presents a difference of -0.001 concerning the 0.535 obtained with the ground truth data. Generally, using the ML-based model offers good results with robust performance over more traditional forms for uncertainty calculation and an effective alternative for real-time computation.

Suggested Citation

  • Carmen Calvo-Olivera & Ángel Manuel Guerrero-Higueras & Jesús Lorenzana & Eduardo García-Ortega, 2024. "Real-Time Evaluation of the Uncertainty in Weather Forecasts Through Machine Learning-Based Models," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 38(7), pages 2455-2470, May.
  • Handle: RePEc:spr:waterr:v:38:y:2024:i:7:d:10.1007_s11269-024-03779-y
    DOI: 10.1007/s11269-024-03779-y
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11269-024-03779-y
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11269-024-03779-y?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Branko Kosovic & Sue Ellen Haupt & Daniel Adriaansen & Stefano Alessandrini & Gerry Wiener & Luca Delle Monache & Yubao Liu & Seth Linden & Tara Jensen & William Cheng & Marcia Politovich & Paul Prest, 2020. "A Comprehensive Wind Power Forecasting System Integrating Artificial Intelligence and Numerical Weather Prediction," Energies, MDPI, vol. 13(6), pages 1-16, March.
    2. Ricardo Torres-López & David Casillas-Pérez & Jorge Pérez-Aracil & Laura Cornejo-Bueno & Enrique Alexandre & Sancho Salcedo-Sanz, 2022. "Analysis of Machine Learning Approaches’ Performance in Prediction Problems with Human Activity Patterns," Mathematics, MDPI, vol. 10(13), pages 1-18, June.
    3. Mahdie Afshari Nia & Fatemeh Panahi & Mohammad Ehteram, 2023. "Convolutional Neural Network- ANN- E (Tanh): A New Deep Learning Model for Predicting Rainfall," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 37(4), pages 1785-1810, March.
    4. Feifei Yang & David W. Wanik & Diego Cerrai & Md Abul Ehsan Bhuiyan & Emmanouil N. Anagnostou, 2020. "Quantifying Uncertainty in Machine Learning-Based Power Outage Prediction Model Training: A Tool for Sustainable Storm Restoration," Sustainability, MDPI, vol. 12(4), pages 1-19, February.
    5. Konrad Bogner & Florian Pappenberger & Massimiliano Zappa, 2019. "Machine Learning Techniques for Predicting the Energy Consumption/Production and Its Uncertainties Driven by Meteorological Observations and Forecasts," Sustainability, MDPI, vol. 11(12), pages 1-22, June.
    6. Romulus Costache & Alireza Arabameri & Iulia Costache & Anca Crăciun & Binh Thai Pham, 2022. "New Machine Learning Ensemble for Flood Susceptibility Estimation," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(12), pages 4765-4783, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tuantuan Zhang & Zhongmin Liang & Chenglin Bi & Jun Wang & Yiming Hu & Binquan Li, 2025. "Statistical Post-Processing for Precipitation Forecast Through Deep Learning Coupling Large-Scale and Local-Scale Spatiotemporal Information," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 39(1), pages 145-160, January.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hughes, William & Zhang, Wei & Cerrai, Diego & Bagtzoglou, Amvrossios & Wanik, David & Anagnostou, Emmanouil, 2022. "A Hybrid Physics-Based and Data-Driven Model for Power Distribution System Infrastructure Hardening and Outage Simulation," Reliability Engineering and System Safety, Elsevier, vol. 225(C).
    2. Hongchen Li & Zhong Yang & Jiaming Han & Shangxiang Lai & Qiuyan Zhang & Chi Zhang & Qianhui Fang & Guoxiong Hu, 2020. "TL-Net: A Novel Network for Transmission Line Scenes Classification," Energies, MDPI, vol. 13(15), pages 1-15, July.
    3. Jayesh Thaker & Robert Höller, 2022. "A Comparative Study of Time Series Forecasting of Solar Energy Based on Irradiance Classification," Energies, MDPI, vol. 15(8), pages 1-26, April.
    4. Rong Qu & Ruibing Kou & Tianyi Zhang, 2024. "The Impact of Weather Variability on Renewable Energy Consumption: Insights from Explainable Machine Learning Models," Sustainability, MDPI, vol. 17(1), pages 1-25, December.
    5. Riswanti Sigalingging & Nasha Putri Sebayang & Noverita Sprinse Vinolina & Lukman Adlin Harahap, 2024. "Modelling of energy demand prediction system in potato farming using deep learning method," Research in Agricultural Engineering, Czech Academy of Agricultural Sciences, vol. 70(4), pages 198-208.
    6. Upma Singh & Mohammad Rizwan & Muhannad Alaraj & Ibrahim Alsaidan, 2021. "A Machine Learning-Based Gradient Boosting Regression Approach for Wind Power Production Forecasting: A Step towards Smart Grid Environments," Energies, MDPI, vol. 14(16), pages 1-21, August.
    7. Tara C. Walsh & David W. Wanik & Emmanouil N. Anagnostou & Jonathan E. Mellor, 2020. "Estimated Time to Restoration of Hurricane Sandy in a Future Climate," Sustainability, MDPI, vol. 12(16), pages 1-27, August.
    8. Berk A. Alpay & David Wanik & Peter Watson & Diego Cerrai & Guannan Liang & Emmanouil Anagnostou, 2020. "Dynamic Modeling of Power Outages Caused by Thunderstorms," Forecasting, MDPI, vol. 2(2), pages 1-12, May.
    9. Yee Van Fan & Zorka Novak Pintarič & Jiří Jaromír Klemeš, 2020. "Emerging Tools for Energy System Design Increasing Economic and Environmental Sustainability," Energies, MDPI, vol. 13(16), pages 1-25, August.
    10. Adam Krechowicz & Maria Krechowicz & Katarzyna Poczeta, 2022. "Machine Learning Approaches to Predict Electricity Production from Renewable Energy Sources," Energies, MDPI, vol. 15(23), pages 1-41, December.
    11. Mohammad Taghi Sattari & Anca Avram & Halit Apaydin & Oliviu Matei, 2023. "Evaluation of Feature Selection Methods in Estimation of Precipitation Based on Deep Learning Artificial Neural Networks," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 37(15), pages 5871-5891, December.
    12. Joseph Oyekale & Mario Petrollese & Vittorio Tola & Giorgio Cau, 2020. "Impacts of Renewable Energy Resources on Effectiveness of Grid-Integrated Systems: Succinct Review of Current Challenges and Potential Solution Strategies," Energies, MDPI, vol. 13(18), pages 1-48, September.
    13. Vikash Shivhare & Alok Kumar & Reetesh Kumar & Satyanarayan Shashtri & Javed Mallick & Chander Kumar Singh, 2024. "Flood susceptibility and flood frequency modeling for lower Kosi Basin, India using AHP and Sentinel-1 SAR data in geospatial environment," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 120(13), pages 11579-11610, October.
    14. Thong Xuan Tran & Sihong Liu & Hang Ha & Quynh Duy Bui & Long Quoc Nguyen & Dinh Quoc Nguyen & Cong-Ty Trinh & Chinh Luu, 2024. "A Spatial Landslide Risk Assessment Based on Hazard, Vulnerability, Exposure, and Adaptive Capacity," Sustainability, MDPI, vol. 16(21), pages 1-37, November.
    15. Muhammad Ahsan Zamee & Dongjun Won, 2020. "Novel Mode Adaptive Artificial Neural Network for Dynamic Learning: Application in Renewable Energy Sources Power Generation Prediction," Energies, MDPI, vol. 13(23), pages 1-29, December.
    16. Md Abul Ehsan Bhuiyan & Feifei Yang & Nishan Kumar Biswas & Saiful Haque Rahat & Tahneen Jahan Neelam, 2020. "Machine Learning-Based Error Modeling to Improve GPM IMERG Precipitation Product over the Brahmaputra River Basin," Forecasting, MDPI, vol. 2(3), pages 1-19, July.
    17. Ahmed Abdelaziz & Vitor Santos & Miguel Sales Dias, 2021. "Machine Learning Techniques in the Energy Consumption of Buildings: A Systematic Literature Review Using Text Mining and Bibliometric Analysis," Energies, MDPI, vol. 14(22), pages 1-31, November.
    18. Paweł Piotrowski & Inajara Rutyna & Dariusz Baczyński & Marcin Kopyt, 2022. "Evaluation Metrics for Wind Power Forecasts: A Comprehensive Review and Statistical Analysis of Errors," Energies, MDPI, vol. 15(24), pages 1-38, December.
    19. Khan, Waqas & Walker, Shalika & Zeiler, Wim, 2022. "Improved solar photovoltaic energy generation forecast using deep learning-based ensemble stacking approach," Energy, Elsevier, vol. 240(C).
    20. Işık, Cem & Kuziboev, Bekhzod & Ongan, Serdar & Saidmamatov, Olimjon & Mirkhoshimova, Mokhirakhon & Rajabov, Alibek, 2024. "The volatility of global energy uncertainty: Renewable alternatives," Energy, Elsevier, vol. 297(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:waterr:v:38:y:2024:i:7:d:10.1007_s11269-024-03779-y. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.