IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v398y2025ics0306261925011225.html

Climate error metrics based on Wasserstein distances

Author

Listed:
  • Veiga Rodrigues, Carlos
  • Odderskov, Io

Abstract

A novel theoretical framework is introduced for generating error metrics free from time-lag errors, specifically designed for long-term wind resource assessment. The proposed metrics enable an enhanced comparison of climate statistics by focusing on the steady-state wind flow conditions rather than transient events. Generally, error between models and observations is characterized through metrics such as the Root Mean Squared Error (RMSE) and its Standard Deviation (STDE). However, these are influenced by time-lags that can distort the evaluation of wind speed predictions if the aim is the characterization of climate and long-term characteristics. No standardized metrics exist that fully eliminate time-lag influences when estimating climate error. The proposed methodology decomposes RMSE and STDE into statistical moments and relates these to the quantile functions of probability distributions. The moments are equated to Wasserstein distances which are used to extract time-independent error metrics. This procedure is applicable to both analytical distributions, such as the Weibull distribution, and empirical distributions from sample-based statistics. Numerical experiments were conducted to validate the effectiveness of the proposed climate metrics, demonstrating the ability to achieve near-zero RMSE for time series with similar statistical distributions, whereas conventional RMSE exceeded 20 % due to phase error.

Suggested Citation

  • Veiga Rodrigues, Carlos & Odderskov, Io, 2025. "Climate error metrics based on Wasserstein distances," Applied Energy, Elsevier, vol. 398(C).
  • Handle: RePEc:eee:appene:v:398:y:2025:i:c:s0306261925011225
    DOI: 10.1016/j.apenergy.2025.126392
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925011225
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.126392?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Loukatou, Angeliki & Howell, Sydney & Johnson, Paul & Duck, Peter, 2018. "Stochastic wind speed modelling for estimation of expected wind power output," Applied Energy, Elsevier, vol. 228(C), pages 1328-1340.
    2. Soukissian, Takvor H. & Karathanasi, Flora E., 2017. "On the selection of bivariate parametric models for wind data," Applied Energy, Elsevier, vol. 188(C), pages 280-304.
    3. Ling, You & Mahadevan, Sankaran, 2013. "Quantitative model validation techniques: New insights," Reliability Engineering and System Safety, Elsevier, vol. 111(C), pages 217-231.
    4. Carvalho, D. & Rocha, A. & Gómez-Gesteira, M. & Silva Santos, C., 2014. "WRF wind simulation and wind energy production estimates forced by different reanalyses: Comparison with observed data for Portugal," Applied Energy, Elsevier, vol. 117(C), pages 116-126.
    5. Chang, Tian Pau, 2011. "Performance comparison of six numerical methods in estimating Weibull parameters for wind energy application," Applied Energy, Elsevier, vol. 88(1), pages 272-282, January.
    6. Quick, Julian & Murcia Leon, Juan Pablo & Kock, Carsten Weber & Servizi, Valentino & Overgaard, Nikolaj Stokholm & Dimitrov, Nikolay & Kelly, Mark & Réthoré, Pierre-Elouan & Kim, Taeseong, 2025. "Wind speed vertical extrapolation model validation under uncertainty," Renewable Energy, Elsevier, vol. 240(C).
    7. Scott Ferson & William L. Oberkampf, 2009. "Validation of imprecise probability models," International Journal of Reliability and Safety, Inderscience Enterprises Ltd, vol. 3(1/2/3), pages 3-22.
    8. Chang, Tian Pau, 2011. "Estimation of wind energy potential using different probability density functions," Applied Energy, Elsevier, vol. 88(5), pages 1848-1856, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chang, Tian-Pau & Ko, Hong-Hsi & Liu, Feng-Jiao & Chen, Pai-Hsun & Chang, Ying-Pin & Liang, Ying-Hsin & Jang, Horng-Yuan & Lin, Tsung-Chi & Chen, Yi-Hwa, 2012. "Fractal dimension of wind speed time series," Applied Energy, Elsevier, vol. 93(C), pages 742-749.
    2. Deep, Sneh & Sarkar, Arnab & Ghawat, Mayur & Rajak, Manoj Kumar, 2020. "Estimation of the wind energy potential for coastal locations in India using the Weibull model," Renewable Energy, Elsevier, vol. 161(C), pages 319-339.
    3. César Henrique Mattos Pires & Felipe M. Pimenta & Carla A. D'Aquino & Osvaldo R. Saavedra & Xuerui Mao & Arcilan T. Assireu, 2020. "Coastal Wind Power in Southern Santa Catarina, Brazil," Energies, MDPI, vol. 13(19), pages 1-23, October.
    4. Ao, Dan & Hu, Zhen & Mahadevan, Sankaran, 2017. "Design of validation experiments for life prediction models," Reliability Engineering and System Safety, Elsevier, vol. 165(C), pages 22-33.
    5. Shu, Z.R. & Li, Q.S. & Chan, P.W., 2015. "Investigation of offshore wind energy potential in Hong Kong based on Weibull distribution function," Applied Energy, Elsevier, vol. 156(C), pages 362-373.
    6. Guedes, Kevin S. & de Andrade, Carla F. & Rocha, Paulo A.C. & Mangueira, Rivanilso dos S. & de Moura, Elineudo P., 2020. "Performance analysis of metaheuristic optimization algorithms in estimating the parameters of several wind speed distributions," Applied Energy, Elsevier, vol. 268(C).
    7. Xu, Lei & Wang, Shengwei & Tang, Rui, 2019. "Probabilistic load forecasting for buildings considering weather forecasting uncertainty and uncertain peak load," Applied Energy, Elsevier, vol. 237(C), pages 180-195.
    8. Emilio Gómez-Lázaro & María C. Bueso & Mathieu Kessler & Sergio Martín-Martínez & Jie Zhang & Bri-Mathias Hodge & Angel Molina-García, 2016. "Probability Density Function Characterization for Aggregated Large-Scale Wind Power Based on Weibull Mixtures," Energies, MDPI, vol. 9(2), pages 1-15, February.
    9. He, J.Y. & Li, Q.S. & Chan, P.W. & Zhao, X.D., 2023. "Assessment of future wind resources under climate change using a multi-model and multi-method ensemble approach," Applied Energy, Elsevier, vol. 329(C).
    10. Guglielmo D’Amico & Giovanni Masala & Filippo Petroni & Robert Adam Sobolewski, 2020. "Managing Wind Power Generation via Indexed Semi-Markov Model and Copula," Energies, MDPI, vol. 13(16), pages 1-21, August.
    11. Akdağ, Seyit Ahmet & Güler, Önder, 2018. "Alternative Moment Method for wind energy potential and turbine energy output estimation," Renewable Energy, Elsevier, vol. 120(C), pages 69-77.
    12. Celik, Ali N. & Kolhe, Mohan, 2013. "Generalized feed-forward based method for wind energy prediction," Applied Energy, Elsevier, vol. 101(C), pages 582-588.
    13. Mazhar Hussain Baloch & Dahaman Ishak & Sohaib Tahir Chaudary & Baqir Ali & Ali Asghar Memon & Touqeer Ahmed Jumani, 2019. "Wind Power Integration: An Experimental Investigation for Powering Local Communities," Energies, MDPI, vol. 12(4), pages 1-24, February.
    14. Gugliani, G.K. & Sarkar, A. & Ley, C. & Mandal, S., 2018. "New methods to assess wind resources in terms of wind speed, load, power and direction," Renewable Energy, Elsevier, vol. 129(PA), pages 168-182.
    15. Kwami Senam A. Sedzro & Adekunlé Akim Salami & Pierre Akuété Agbessi & Mawugno Koffi Kodjo, 2022. "Comparative Study of Wind Energy Potential Estimation Methods for Wind Sites in Togo and Benin (West Sub-Saharan Africa)," Energies, MDPI, vol. 15(22), pages 1-28, November.
    16. Alkhalidi, Mohamad A. & Al-Dabbous, Shoug Kh. & Neelamani, S. & Aldashti, Hassan A., 2019. "Wind energy potential at coastal and offshore locations in the state of Kuwait," Renewable Energy, Elsevier, vol. 135(C), pages 529-539.
    17. Jain, Tanmay & Verma, Kusum, 2024. "Reliability based computational model for stochastic unit commitment of a bulk power system integrated with volatile wind power," Reliability Engineering and System Safety, Elsevier, vol. 244(C).
    18. Usta, Ilhan, 2016. "An innovative estimation method regarding Weibull parameters for wind energy applications," Energy, Elsevier, vol. 106(C), pages 301-314.
    19. Wang, Chong & Matthies, Hermann G., 2019. "Novel model calibration method via non-probabilistic interval characterization and Bayesian theory," Reliability Engineering and System Safety, Elsevier, vol. 183(C), pages 84-92.
    20. He, Junyi & Chan, P.W. & Li, Qiusheng & Lee, C.W., 2020. "Spatiotemporal analysis of offshore wind field characteristics and energy potential in Hong Kong," Energy, Elsevier, vol. 201(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:398:y:2025:i:c:s0306261925011225. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.