IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i9p3789-d1135670.html
   My bibliography  Save this article

Ultra-Short-Term Wind Power Prediction Based on LSTM with Loss Shrinkage Adam

Author

Listed:
  • Jingtao Huang

    (College of Information Engineering, Henan University of Science and Technology, Luoyang 471023, China)

  • Gang Niu

    (College of Information Engineering, Henan University of Science and Technology, Luoyang 471023, China)

  • Haiping Guan

    (Tongliao SPIC Power Generation Corporation Limited, Tongliao 028001, China)

  • Shuzhong Song

    (College of Information Engineering, Henan University of Science and Technology, Luoyang 471023, China)

Abstract

With the rapid increase in wind power, its strong randomness has brought great challenges to power system operation. Accurate and timely ultra-short-term wind power prediction is essential for the stable operation of power systems. In this paper, an LsAdam–LSTM model is proposed for ultra-short-term wind power prediction, which is obtained by accelerating the long short-term memory (LSTM) network using an improved Adam optimizer with loss shrinkage (LsAdam). For a specific network topology, training progress heavily depends on the learning rate. To make the training loss of LSTM shrink faster with standard Adam, we use the past training loss-changing information to finely tune the next learning rate. Therefore, we design a gain coefficient according to the loss change to adjust the global learning rate in every epoch. In this way, the loss change in the training process can be incorporated into the learning progress and a closed-loop adaptive learning rate tuning mechanism can be constructed. Drastic changes in network parameters will deteriorate learning progress and even make the model non-converging, so the gain coefficient is designed based on the arctangent function with self-limiting properties. Because the learning rate is iteratively tuned with past loss-changing information, the trained model will have better performance. The test results on a wind turbine show that the LsAdam–LSTM model can obtain higher prediction accuracy with much fewer training epochs compared with Adam–LSTM, and the prediction accuracy has significant improvements compared with BP and SVR models.

Suggested Citation

  • Jingtao Huang & Gang Niu & Haiping Guan & Shuzhong Song, 2023. "Ultra-Short-Term Wind Power Prediction Based on LSTM with Loss Shrinkage Adam," Energies, MDPI, vol. 16(9), pages 1-13, April.
  • Handle: RePEc:gam:jeners:v:16:y:2023:i:9:p:3789-:d:1135670
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/9/3789/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/16/9/3789/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dongyu Wang & Xiwen Cui & Dongxiao Niu, 2022. "Wind Power Forecasting Based on LSTM Improved by EMD-PCA-RF," Sustainability, MDPI, vol. 14(12), pages 1-23, June.
    2. Kumar, Yogesh & Ringenberg, Jordan & Depuru, Soma Shekara & Devabhaktuni, Vijay K. & Lee, Jin Woo & Nikolaidis, Efstratios & Andersen, Brett & Afjeh, Abdollah, 2016. "Wind energy: Trends and enabling technologies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 53(C), pages 209-224.
    3. Bingchun Liu & Shijie Zhao & Xiaogang Yu & Lei Zhang & Qingshan Wang, 2020. "A Novel Deep Learning Approach for Wind Power Forecasting Based on WD-LSTM Model," Energies, MDPI, vol. 13(18), pages 1-17, September.
    4. Dinh Thanh Viet & Vo Van Phuong & Minh Quan Duong & Quoc Tuan Tran, 2020. "Models for Short-Term Wind Power Forecasting Based on Improved Artificial Neural Network Using Particle Swarm Optimization and Genetic Algorithms," Energies, MDPI, vol. 13(11), pages 1-22, June.
    5. Tawn, R. & Browell, J., 2022. "A review of very short-term wind and solar power forecasting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 153(C).
    6. Namrye Son & Seunghak Yang & Jeongseung Na, 2019. "Hybrid Forecasting Model for Short-Term Wind Power Prediction Using Modified Long Short-Term Memory," Energies, MDPI, vol. 12(20), pages 1-17, October.
    7. Abdulelah Alkesaiberi & Fouzi Harrou & Ying Sun, 2022. "Efficient Wind Power Prediction Using Machine Learning Methods: A Comparative Study," Energies, MDPI, vol. 15(7), pages 1-24, March.
    8. Shahram Hanifi & Xiaolei Liu & Zi Lin & Saeid Lotfian, 2020. "A Critical Review of Wind Power Forecasting Methods—Past, Present and Future," Energies, MDPI, vol. 13(15), pages 1-24, July.
    9. Chia-Sheng Tu & Chih-Ming Hong & Hsi-Shan Huang & Chiung-Hsing Chen, 2020. "Short Term Wind Power Prediction Based on Data Regression and Enhanced Support Vector Machine," Energies, MDPI, vol. 13(23), pages 1-18, November.
    10. Yuyang Gao & Chao Qu & Kequan Zhang, 2016. "A Hybrid Method Based on Singular Spectrum Analysis, Firefly Algorithm, and BP Neural Network for Short-Term Wind Speed Forecasting," Energies, MDPI, vol. 9(10), pages 1-28, September.
    11. Han, Li & Jing, Huitian & Zhang, Rongchang & Gao, Zhiyu, 2019. "Wind power forecast based on improved Long Short Term Memory network," Energy, Elsevier, vol. 189(C).
    12. Qiuhong Huang & Xiao Wang, 2022. "A Forecasting Model of Wind Power Based on IPSO–LSTM and Classified Fusion," Energies, MDPI, vol. 15(15), pages 1-19, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Wen-Chang Tsai & Chih-Ming Hong & Chia-Sheng Tu & Whei-Min Lin & Chiung-Hsing Chen, 2023. "A Review of Modern Wind Power Generation Forecasting Technologies," Sustainability, MDPI, vol. 15(14), pages 1-40, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Paweł Piotrowski & Inajara Rutyna & Dariusz Baczyński & Marcin Kopyt, 2022. "Evaluation Metrics for Wind Power Forecasts: A Comprehensive Review and Statistical Analysis of Errors," Energies, MDPI, vol. 15(24), pages 1-38, December.
    2. Manisha Sawant & Rupali Patil & Tanmay Shikhare & Shreyas Nagle & Sakshi Chavan & Shivang Negi & Neeraj Dhanraj Bokde, 2022. "A Selective Review on Recent Advancements in Long, Short and Ultra-Short-Term Wind Power Prediction," Energies, MDPI, vol. 15(21), pages 1-24, October.
    3. Abdulelah Alkesaiberi & Fouzi Harrou & Ying Sun, 2022. "Efficient Wind Power Prediction Using Machine Learning Methods: A Comparative Study," Energies, MDPI, vol. 15(7), pages 1-24, March.
    4. Yiyang Sun & Xiangwen Wang & Junjie Yang, 2022. "Modified Particle Swarm Optimization with Attention-Based LSTM for Wind Power Prediction," Energies, MDPI, vol. 15(12), pages 1-17, June.
    5. Minan Tang & Wenjuan Wang & Jiandong Qiu & Detao Li & Linyuan Lei, 2022. "Active Power Cooperative Control for Wind Power Clusters with Multiple Temporal and Spatial Scales," Energies, MDPI, vol. 15(24), pages 1-21, December.
    6. Yang, Ting & Yang, Zhenning & Li, Fei & Wang, Hengyu, 2024. "A short-term wind power forecasting method based on multivariate signal decomposition and variable selection," Applied Energy, Elsevier, vol. 360(C).
    7. Farah, Shahid & David A, Wood & Humaira, Nisar & Aneela, Zameer & Steffen, Eger, 2022. "Short-term multi-hour ahead country-wide wind power prediction for Germany using gated recurrent unit deep learning," Renewable and Sustainable Energy Reviews, Elsevier, vol. 167(C).
    8. Abdulrahman A. Alghamdi & Abdelhameed Ibrahim & El-Sayed M. El-Kenawy & Abdelaziz A. Abdelhamid, 2023. "Renewable Energy Forecasting Based on Stacking Ensemble Model and Al-Biruni Earth Radius Optimization Algorithm," Energies, MDPI, vol. 16(3), pages 1-30, January.
    9. Yang, Mao & Wang, Da & Zhang, Wei, 2023. "A short-term wind power prediction method based on dynamic and static feature fusion mining," Energy, Elsevier, vol. 280(C).
    10. Xu Ran & Chang Xu & Lei Ma & Feifei Xue, 2022. "Wind Power Interval Prediction with Adaptive Rolling Error Correction Based on PSR-BLS-QR," Energies, MDPI, vol. 15(11), pages 1-22, June.
    11. Karthick Kanagarathinam & S. K. Aruna & S. Ravivarman & Mejdl Safran & Sultan Alfarhood & Waleed Alrajhi, 2023. "Enhancing Sustainable Urban Energy Management through Short-Term Wind Power Forecasting Using LSTM Neural Network," Sustainability, MDPI, vol. 15(18), pages 1-18, September.
    12. Wen-Chang Tsai & Chih-Ming Hong & Chia-Sheng Tu & Whei-Min Lin & Chiung-Hsing Chen, 2023. "A Review of Modern Wind Power Generation Forecasting Technologies," Sustainability, MDPI, vol. 15(14), pages 1-40, July.
    13. Yang, Mao & Wang, Da & Zhang, Wei, 2024. "A novel ultra short-term wind power prediction model based on double model coordination switching mechanism," Energy, Elsevier, vol. 289(C).
    14. Liu, Xiaolei & Lin, Zi & Feng, Ziming, 2021. "Short-term offshore wind speed forecast by seasonal ARIMA - A comparison against GRU and LSTM," Energy, Elsevier, vol. 227(C).
    15. Heo, SungKu & Byun, Jaewon & Ifaei, Pouya & Ko, Jaerak & Ha, Byeongmin & Hwangbo, Soonho & Yoo, ChangKyoo, 2024. "Towards mega-scale decarbonized industrial park (Mega-DIP): Generative AI-driven techno-economic and environmental assessment of renewable and sustainable energy utilization in petrochemical industry," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PA).
    16. Periklis Gogas & Theophilos Papadimitriou, 2023. "Machine Learning in Renewable Energy," Energies, MDPI, vol. 16(5), pages 1-3, February.
    17. Liu, Zepeng & Zhang, Long & Carrasco, Joaquin, 2020. "Vibration analysis for large-scale wind turbine blade bearing fault detection with an empirical wavelet thresholding method," Renewable Energy, Elsevier, vol. 146(C), pages 99-110.
    18. Yi Wang & Zhengxiang He & Liguan Wang, 2021. "Truck Driver Fatigue Detection Based on Video Sequences in Open-Pit Mines," Mathematics, MDPI, vol. 9(22), pages 1-14, November.
    19. Saima Akhtar & Sulman Shahzad & Asad Zaheer & Hafiz Sami Ullah & Heybet Kilic & Radomir Gono & Michał Jasiński & Zbigniew Leonowicz, 2023. "Short-Term Load Forecasting Models: A Review of Challenges, Progress, and the Road Ahead," Energies, MDPI, vol. 16(10), pages 1-29, May.
    20. Wang, Delu & Gan, Jun & Mao, Jinqi & Chen, Fan & Yu, Lan, 2023. "Forecasting power demand in China with a CNN-LSTM model including multimodal information," Energy, Elsevier, vol. 263(PE).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:9:p:3789-:d:1135670. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.