IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v238y2022ipbs0360544221020569.html
   My bibliography  Save this article

A novel loss function of deep learning in wind speed forecasting

Author

Listed:
  • Chen, Xi
  • Yu, Ruyi
  • Ullah, Sajid
  • Wu, Dianming
  • Li, Zhiqiang
  • Li, Qingli
  • Qi, Honggang
  • Liu, Jihui
  • Liu, Min
  • Zhang, Yundong

Abstract

Wind speed forecasting is an essential task in improving the efficiency of the energy supply. Currently, deep learning models have become extremely popular, where the traditional mean squared error (MSE) loss function is often employed. Unfortunately, the MSE loss function cannot accurately measure the nonlinearity of wind speed data, and new loss functions have seldom been developed for wind speed forecasting. In addition, the MSE loss function is sensitive to outliers, degrading the stability. To address these problems, we propose a kernel MSE loss function to evaluate the ubiquitous nonlinearity of deep learning errors in the reproducing kernel Hilbert space. The new loss function utilizes the kernel skills in the loss function of deep learning methods for the first time. The first and second derivatives of the new loss function guarantee the robustness against outliers. The experimental results with three fundamental deep learning methods on three public datasets validate that the new loss function is efficient and superior in most cases, and its resultant error can be 95% smaller than MSE in multiple step prediction. The results imply that developing a loss function with kernel skills is a new way to get better results.

Suggested Citation

  • Chen, Xi & Yu, Ruyi & Ullah, Sajid & Wu, Dianming & Li, Zhiqiang & Li, Qingli & Qi, Honggang & Liu, Jihui & Liu, Min & Zhang, Yundong, 2022. "A novel loss function of deep learning in wind speed forecasting," Energy, Elsevier, vol. 238(PB).
  • Handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221020569
    DOI: 10.1016/j.energy.2021.121808
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544221020569
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2021.121808?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lilin Cheng & Haixiang Zang & Tao Ding & Rong Sun & Miaomiao Wang & Zhinong Wei & Guoqiang Sun, 2018. "Ensemble Recurrent Neural Network Based Probabilistic Wind Speed Forecasting Approach," Energies, MDPI, vol. 11(8), pages 1-23, July.
    2. Liu, Zhenkun & Jiang, Ping & Zhang, Lifang & Niu, Xinsong, 2020. "A combined forecasting model for time series: Application to short-term wind speed forecasting," Applied Energy, Elsevier, vol. 259(C).
    3. Fadare, D.A., 2010. "The application of artificial neural networks to mapping of wind speed profile for energy application in Nigeria," Applied Energy, Elsevier, vol. 87(3), pages 934-942, March.
    4. Jiang, Ping & Wang, Biao & Li, Hongmin & Lu, Haiyan, 2019. "Modeling for chaotic time series based on linear and nonlinear framework: Application to wind speed forecasting," Energy, Elsevier, vol. 173(C), pages 468-482.
    5. Liu, Hui & Tian, Hong-qi & Li, Yan-fei, 2012. "Comparison of two new ARIMA-ANN and ARIMA-Kalman hybrid methods for wind speed prediction," Applied Energy, Elsevier, vol. 98(C), pages 415-424.
    6. Li, Yanfei & Shi, Huipeng & Han, Fengze & Duan, Zhu & Liu, Hui, 2019. "Smart wind speed forecasting approach using various boosting algorithms, big multi-step forecasting strategy," Renewable Energy, Elsevier, vol. 135(C), pages 540-553.
    7. Sewdien, V.N. & Preece, R. & Torres, J.L. Rueda & Rakhshani, E. & van der Meijden, M., 2020. "Assessment of critical parameters for artificial neural networks based short-term wind generation forecasting," Renewable Energy, Elsevier, vol. 161(C), pages 878-892.
    8. Karasu, Seçkin & Altan, Aytaç & Bekiros, Stelios & Ahmad, Wasim, 2020. "A new forecasting model with wrapper-based feature selection approach using multi-objective optimization technique for chaotic crude oil time series," Energy, Elsevier, vol. 212(C).
    9. Zhang, Chi & Wei, Haikun & Zhao, Junsheng & Liu, Tianhong & Zhu, Tingting & Zhang, Kanjian, 2016. "Short-term wind speed forecasting using empirical mode decomposition and feature selection," Renewable Energy, Elsevier, vol. 96(PA), pages 727-737.
    10. Chang, G.W. & Lu, H.J. & Chang, Y.R. & Lee, Y.D., 2017. "An improved neural network-based approach for short-term wind speed and power forecast," Renewable Energy, Elsevier, vol. 105(C), pages 301-311.
    11. Altan, Aytaç & Karasu, Seçkin & Bekiros, Stelios, 2019. "Digital currency forecasting with chaotic meta-heuristic bio-inspired signal processing techniques," Chaos, Solitons & Fractals, Elsevier, vol. 126(C), pages 325-336.
    12. Yin, Xiuxing & Zhao, Xiaowei & Lin, Jin & Karcanias, Aris, 2020. "Reliability aware multi-objective predictive control for wind farm based on machine learning and heuristic optimizations," Energy, Elsevier, vol. 202(C).
    13. Zhang, Wenyu & Zhang, Lifang & Wang, Jianzhou & Niu, Xinsong, 2020. "Hybrid system based on a multi-objective optimization and kernel approximation for multi-scale wind speed forecasting," Applied Energy, Elsevier, vol. 277(C).
    14. Wang, Huai-zhi & Li, Gang-qiang & Wang, Gui-bin & Peng, Jian-chun & Jiang, Hui & Liu, Yi-tao, 2017. "Deep learning based ensemble approach for probabilistic wind power forecasting," Applied Energy, Elsevier, vol. 188(C), pages 56-70.
    15. Ziel, Florian & Croonenbroeck, Carsten & Ambach, Daniel, 2016. "Forecasting wind power – Modeling periodic and non-linear effects under conditional heteroscedasticity," Applied Energy, Elsevier, vol. 177(C), pages 285-297.
    16. Li, Chen & Zhu, Zhijie & Yang, Hufang & Li, Ranran, 2019. "An innovative hybrid system for wind speed forecasting based on fuzzy preprocessing scheme and multi-objective optimization," Energy, Elsevier, vol. 174(C), pages 1219-1237.
    17. Hyndman, Rob J. & Koehler, Anne B., 2006. "Another look at measures of forecast accuracy," International Journal of Forecasting, Elsevier, vol. 22(4), pages 679-688.
    18. Lago, Jesus & De Ridder, Fjo & De Schutter, Bart, 2018. "Forecasting spot electricity prices: Deep learning approaches and empirical comparison of traditional algorithms," Applied Energy, Elsevier, vol. 221(C), pages 386-405.
    19. Liu, Da & Wang, Jilong & Wang, Hui, 2015. "Short-term wind speed forecasting based on spectral clustering and optimised echo state networks," Renewable Energy, Elsevier, vol. 78(C), pages 599-608.
    20. Hong, Ying-Yi & Satriani, Thursy Rienda Aulia, 2020. "Day-ahead spatiotemporal wind speed forecasting using robust design-based deep learning neural network," Energy, Elsevier, vol. 209(C).
    21. Altan, Aytaç & Karasu, Seçkin, 2020. "Recognition of COVID-19 disease from X-ray images by hybrid model consisting of 2D curvelet transform, chaotic salp swarm algorithm and deep learning technique," Chaos, Solitons & Fractals, Elsevier, vol. 140(C).
    22. Liu, Hui & Yu, Chengqing & Wu, Haiping & Duan, Zhu & Yan, Guangxi, 2020. "A new hybrid ensemble deep reinforcement learning model for wind speed short term forecasting," Energy, Elsevier, vol. 202(C).
    23. Hu, Qinghua & Zhang, Rujia & Zhou, Yucan, 2016. "Transfer learning for short-term wind speed prediction with deep neural networks," Renewable Energy, Elsevier, vol. 85(C), pages 83-95.
    24. Wang, Shouxiang & Zhang, Na & Wu, Lei & Wang, Yamin, 2016. "Wind speed forecasting based on the hybrid ensemble empirical mode decomposition and GA-BP neural network method," Renewable Energy, Elsevier, vol. 94(C), pages 629-636.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Li, Min & Yang, Yi & He, Zhaoshuang & Guo, Xinbo & Zhang, Ruisheng & Huang, Bingqing, 2023. "A wind speed forecasting model based on multi-objective algorithm and interpretability learning," Energy, Elsevier, vol. 269(C).
    2. Zhang, Chu & Ji, Chunlei & Hua, Lei & Ma, Huixin & Nazir, Muhammad Shahzad & Peng, Tian, 2022. "Evolutionary quantile regression gated recurrent unit network based on variational mode decomposition, improved whale optimization algorithm for probabilistic short-term wind speed prediction," Renewable Energy, Elsevier, vol. 197(C), pages 668-682.
    3. Wang, Xuguang & Li, Xiao & Su, Jie, 2023. "Distribution drift-adaptive short-term wind speed forecasting," Energy, Elsevier, vol. 273(C).
    4. Pan Wu & Jinlong Li & Yuzhuang Pian & Xiaochen Li & Zilin Huang & Lunhui Xu & Guilin Li & Ruonan Li, 2022. "How Determinants Affect Transfer Ridership between Metro and Bus Systems: A Multivariate Generalized Poisson Regression Analysis Method," Sustainability, MDPI, vol. 14(15), pages 1-31, August.
    5. Yi Xiao & Minghu Xie & Yi Hu & Ming Yi, 2023. "Effective multi‐step ahead container throughput forecasting under the complex context," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1823-1843, November.
    6. Yang, Xiaolin & Zhang, Kefei & Ni, Chao & Cao, Hua & Thé, Jesse & Xie, Guangyuan & Tan, Zhongchao & Yu, Hesheng, 2022. "Ash determination of coal flotation concentrate by analyzing froth image using a novel hybrid model based on deep learning algorithms and attention mechanism," Energy, Elsevier, vol. 260(C).
    7. Zhang, Xinru & Hou, Lei & Liu, Jiaquan & Yang, Kai & Chai, Chong & Li, Yanhao & He, Sichen, 2022. "Energy consumption prediction for crude oil pipelines based on integrating mechanism analysis and data mining," Energy, Elsevier, vol. 254(PB).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Yun & Zou, Runmin & Liu, Fang & Zhang, Lingjun & Liu, Qianyi, 2021. "A review of wind speed and wind power forecasting with deep neural networks," Applied Energy, Elsevier, vol. 304(C).
    2. Shang, Zhihao & He, Zhaoshuang & Chen, Yao & Chen, Yanhua & Xu, MingLiang, 2022. "Short-term wind speed forecasting system based on multivariate time series and multi-objective optimization," Energy, Elsevier, vol. 238(PC).
    3. Liu, Hui & Chen, Chao, 2019. "Data processing strategies in wind energy forecasting models and applications: A comprehensive review," Applied Energy, Elsevier, vol. 249(C), pages 392-408.
    4. Liang, Tao & Zhao, Qing & Lv, Qingzhao & Sun, Hexu, 2021. "A novel wind speed prediction strategy based on Bi-LSTM, MOOFADA and transfer learning for centralized control centers," Energy, Elsevier, vol. 230(C).
    5. Li, Ke & Shen, Ruifang & Wang, Zhenguo & Yan, Bowen & Yang, Qingshan & Zhou, Xuhong, 2023. "An efficient wind speed prediction method based on a deep neural network without future information leakage," Energy, Elsevier, vol. 267(C).
    6. Qian, Zheng & Pei, Yan & Zareipour, Hamidreza & Chen, Niya, 2019. "A review and discussion of decomposition-based hybrid models for wind energy forecasting applications," Applied Energy, Elsevier, vol. 235(C), pages 939-953.
    7. Marugán, Alberto Pliego & Márquez, Fausto Pedro García & Perez, Jesus María Pinar & Ruiz-Hernández, Diego, 2018. "A survey of artificial neural network in wind energy systems," Applied Energy, Elsevier, vol. 228(C), pages 1822-1836.
    8. Vladimir Simankov & Pavel Buchatskiy & Semen Teploukhov & Stefan Onishchenko & Anatoliy Kazak & Petr Chetyrbok, 2023. "Review of Estimating and Predicting Models of the Wind Energy Amount," Energies, MDPI, vol. 16(16), pages 1-24, August.
    9. Lu, Peng & Ye, Lin & Tang, Yong & Zhao, Yongning & Zhong, Wuzhi & Qu, Ying & Zhai, Bingxu, 2021. "Ultra-short-term combined prediction approach based on kernel function switch mechanism," Renewable Energy, Elsevier, vol. 164(C), pages 842-866.
    10. Zhang, Jinliang & Wei, Yiming & Tan, Zhongfu, 2020. "An adaptive hybrid model for short term wind speed forecasting," Energy, Elsevier, vol. 190(C).
    11. Li, Wenzhe & Jia, Xiaodong & Li, Xiang & Wang, Yinglu & Lee, Jay, 2021. "A Markov model for short term wind speed prediction by integrating the wind acceleration information," Renewable Energy, Elsevier, vol. 164(C), pages 242-253.
    12. Rajpal, Sheetal & Lakhyani, Navin & Singh, Ayush Kumar & Kohli, Rishav & Kumar, Naveen, 2021. "Using handpicked features in conjunction with ResNet-50 for improved detection of COVID-19 from chest X-ray images," Chaos, Solitons & Fractals, Elsevier, vol. 145(C).
    13. Acikgoz, Hakan & Budak, Umit & Korkmaz, Deniz & Yildiz, Ceyhun, 2021. "WSFNet: An efficient wind speed forecasting model using channel attention-based densely connected convolutional neural network," Energy, Elsevier, vol. 233(C).
    14. Dongxiao Niu & Yi Liang & Wei-Chiang Hong, 2017. "Wind Speed Forecasting Based on EMD and GRNN Optimized by FOA," Energies, MDPI, vol. 10(12), pages 1-18, December.
    15. Cui, Yang & Chen, Zhenghong & He, Yingjie & Xiong, Xiong & Li, Fen, 2023. "An algorithm for forecasting day-ahead wind power via novel long short-term memory and wind power ramp events," Energy, Elsevier, vol. 263(PC).
    16. Wang, Kejun & Qi, Xiaoxia & Liu, Hongda & Song, Jiakang, 2018. "Deep belief network based k-means cluster approach for short-term wind power forecasting," Energy, Elsevier, vol. 165(PA), pages 840-852.
    17. Lu, Hongfang & Ma, Xin & Huang, Kun & Azimi, Mohammadamin, 2020. "Prediction of offshore wind farm power using a novel two-stage model combining kernel-based nonlinear extension of the Arps decline model with a multi-objective grey wolf optimizer," Renewable and Sustainable Energy Reviews, Elsevier, vol. 127(C).
    18. Chen, Xue-Jun & Zhao, Jing & Jia, Xiao-Zhong & Li, Zhong-Long, 2021. "Multi-step wind speed forecast based on sample clustering and an optimized hybrid system," Renewable Energy, Elsevier, vol. 165(P1), pages 595-611.
    19. Sizhou Sun & Jingqi Fu & Ang Li, 2019. "A Compound Wind Power Forecasting Strategy Based on Clustering, Two-Stage Decomposition, Parameter Optimization, and Optimal Combination of Multiple Machine Learning Approaches," Energies, MDPI, vol. 12(18), pages 1-22, September.
    20. Sun, Mucun & Feng, Cong & Zhang, Jie, 2020. "Multi-distribution ensemble probabilistic wind power forecasting," Renewable Energy, Elsevier, vol. 148(C), pages 135-149.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:238:y:2022:i:pb:s0360544221020569. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.