IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i19p14452-d1253033.html
   My bibliography  Save this article

Adaptive Active Disturbance Rejection Load Frequency Control for Power System with Renewable Energies Using the Lyapunov Reward-Based Twin Delayed Deep Deterministic Policy Gradient Algorithm

Author

Listed:
  • Yuemin Zheng

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Jin Tao

    (Silo AI, 00100 Helsinki, Finland)

  • Qinglin Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Hao Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Zengqiang Chen

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Mingwei Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

Abstract

The substitution of renewable energy sources (RESs) for conventional fossil fuels in electricity generation is essential in addressing environmental pollution and resource depletion. However, the integration of RESs in the load frequency control (LFC) of power systems can have a negative impact on frequency deviation response, resulting in a decline in power quality. Moreover, load disturbances can also affect the stability of frequency deviation. Hence, this paper presents an LFC method that utilizes the Lyapunov reward-based twin delayed deep deterministic policy gradient (LTD3) algorithm to optimize the linear active disturbance rejection control (LADRC). With the advantages of being model-free and mitigating unknown disturbances, LADRC can regulate load disturbances and renewable energy deviations. Additionally, the LTD3 algorithm, based on the Lyapunov reward function, is employed to optimize controller parameters in real-time, resulting in enhanced control performance. Finally, the LADRC-LTD3 is evaluated using a power system containing two areas, comprising thermal, hydro, and gas power plants in each area, as well as RESs such as a noise-based wind turbine and photovoltaic (PV) system. A comparative analysis is conducted between the performance of the proposed controller and other control techniques, such as integral controller (IC), fractional-order proportional integral derivative (FOPID) controller, I-TD, ID-T, and TD3-optimized LADRC. The results indicate that the proposed method effectively addresses the LFC problem.

Suggested Citation

  • Yuemin Zheng & Jin Tao & Qinglin Sun & Hao Sun & Zengqiang Chen & Mingwei Sun, 2023. "Adaptive Active Disturbance Rejection Load Frequency Control for Power System with Renewable Energies Using the Lyapunov Reward-Based Twin Delayed Deep Deterministic Policy Gradient Algorithm," Sustainability, MDPI, vol. 15(19), pages 1-25, October.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:19:p:14452-:d:1253033
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/19/14452/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/19/14452/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yuemin Zheng & Jin Tao & Qinglin Sun & Hao Sun & Zengqiang Chen & Mingwei Sun & Feng Duan, 2022. "Deep-Reinforcement-Learning-Based Active Disturbance Rejection Control for Lateral Path Following of Parafoil System," Sustainability, MDPI, vol. 15(1), pages 1-18, December.
    2. Ruisheng Wang & Zhong Chen & Qiang Xing & Ziqi Zhang & Tian Zhang, 2022. "A Modified Rainbow-Based Deep Reinforcement Learning Method for Optimal Scheduling of Charging Station," Sustainability, MDPI, vol. 14(3), pages 1-14, February.
    3. Zhou, Ping & Hu, Xikui & Zhu, Zhigang & Ma, Jun, 2021. "What is the most suitable Lyapunov function?," Chaos, Solitons & Fractals, Elsevier, vol. 150(C).
    4. Huang, Ruchen & He, Hongwen & Zhao, Xuyang & Wang, Yunlong & Li, Menglin, 2022. "Battery health-aware and naturalistic data-driven energy management for hybrid electric bus based on TD3 deep reinforcement learning algorithm," Applied Energy, Elsevier, vol. 321(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tang, Tianfeng & Peng, Qianlong & Shi, Qing & Peng, Qingguo & Zhao, Jin & Chen, Chaoyi & Wang, Guangwei, 2024. "Energy management of fuel cell hybrid electric bus in mountainous regions: A deep reinforcement learning approach considering terrain characteristics," Energy, Elsevier, vol. 311(C).
    2. Xin Liu & Guojing Shi & Changbo Yang & Enyong Xu & Yanmei Meng, 2024. "Co-Optimization of Speed Planning and Energy Management for Plug-In Hybrid Electric Trucks Passing Through Traffic Light Intersections," Energies, MDPI, vol. 17(23), pages 1-22, November.
    3. Njitacke, Zeric Tabekoueng & Ramadoss, Janarthanan & Takembo, Clovis Ntahkie & Rajagopal, Karthikeyan & Awrejcewicz, Jan, 2023. "An enhanced FitzHugh–Nagumo neuron circuit, microcontroller-based hardware implementation: Light illumination and magnetic field effects on information patterns," Chaos, Solitons & Fractals, Elsevier, vol. 167(C).
    4. Zhou, Ping & Ma, Jun & Xu, Ying, 2023. "Phase synchronization between neurons under nonlinear coupling via hybrid synapse," Chaos, Solitons & Fractals, Elsevier, vol. 169(C).
    5. Lei, Yong & Xu, Xin-Jian & Wang, Xiaofan & Zou, Yong & Kurths, Jürgen, 2023. "A new criterion for optimizing synchrony of coupled oscillators," Chaos, Solitons & Fractals, Elsevier, vol. 168(C).
    6. Fescioglu-Unver, Nilgun & Yıldız Aktaş, Melike, 2023. "Electric vehicle charging service operations: A review of machine learning applications for infrastructure planning, control, pricing and routing," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    7. Njitacke, Zeric Tabekoueng & Ramakrishnan, Balamurali & Rajagopal, Karthikeyan & Fonzin Fozin, Théophile & Awrejcewicz, Jan, 2022. "Extremely rich dynamics of coupled heterogeneous neurons through a Josephson junction synapse," Chaos, Solitons & Fractals, Elsevier, vol. 164(C).
    8. Hamza Assia & Houari Merabet Boulouiha & William David Chicaiza & Juan Manuel Escaño & Abderrahmane Kacimi & José Luis Martínez-Ramos & Mouloud Denai, 2023. "Wind Turbine Active Fault Tolerant Control Based on Backstepping Active Disturbance Rejection Control and a Neurofuzzy Detector," Energies, MDPI, vol. 16(14), pages 1-22, July.
    9. Hou, Guolian & Huang, Ting & Zheng, Fumeng & Huang, Congzhi, 2024. "A hierarchical reinforcement learning GPC for flexible operation of ultra-supercritical unit considering economy," Energy, Elsevier, vol. 289(C).
    10. Huang, Xuejin & Zhang, Jingyi & Ou, Kai & Huang, Yin & Kang, Zehao & Mao, Xuping & Zhou, Yujie & Xuan, Dongji, 2024. "Deep reinforcement learning-based health-conscious energy management for fuel cell hybrid electric vehicles in model predictive control framework," Energy, Elsevier, vol. 304(C).
    11. Hou, Yi-You & Lin, Ming-Hung & Saberi-Nik, Hassan & Arya, Yogendra, 2024. "Boundary analysis and energy feedback control of fractional-order extended Malkus–Robbins dynamo system," Chaos, Solitons & Fractals, Elsevier, vol. 183(C).
    12. Ma, Jun, 2024. "Energy function for some maps and nonlinear oscillators," Applied Mathematics and Computation, Elsevier, vol. 463(C).
    13. Rui Li & Dongjie Wang & Weixiong Zheng & Tong Li & Miao Wu, 2025. "Path Navigation and Precise Deviation Correction Control for Tracked Roadheaders in Confined Roadway Spaces of Underground Coal Mines," Mathematics, MDPI, vol. 13(16), pages 1-33, August.
    14. Nie, Huaqing & Liu, Jian & Wang, Dan & Zhang, Fangfang & Wang, Wenjing, 2025. "Firing modes of a memristive complex-valued FHN neuron," Chaos, Solitons & Fractals, Elsevier, vol. 196(C).
    15. Ijaz Ahmed & Um-E-Habiba Alvi & Abdul Basit & Tayyaba Khursheed & Alwena Alvi & Keum-Shik Hong & Muhammad Rehan, 2022. "A novel hybrid soft computing optimization framework for dynamic economic dispatch problem of complex non-convex contiguous constrained machines," PLOS ONE, Public Library of Science, vol. 17(1), pages 1-32, January.
    16. Sun, Guoping & Yang, Feifei & Ren, Guodong & Wang, Chunni, 2023. "Energy encoding in a biophysical neuron and adaptive energy balance under field coupling," Chaos, Solitons & Fractals, Elsevier, vol. 169(C).
    17. Ren, Lei & Lin, Ming-Hung & Abdulwahab, Abdulkareem & Ma, Jun & Saberi-Nik, Hassan, 2023. "Global dynamical analysis of the integer and fractional 4D hyperchaotic Rabinovich system," Chaos, Solitons & Fractals, Elsevier, vol. 169(C).
    18. Wang, Zhong & Zhao, Yahui & Zhang, Yahui & Tian, Yang & Jiao, Xiaohong, 2024. "Safe off-policy reinforcement learning on eco-driving for a P2-P3 hybrid electric truck," Energy, Elsevier, vol. 313(C).
    19. Xiao, Wu & Min, Fuhong & Lu, Jiakai & Huo, Hailong, 2025. "Pattern transition and bifurcation analysis of ELU-type memristive FitzHugh-Nagumo neuron," Chaos, Solitons & Fractals, Elsevier, vol. 191(C).
    20. Zhang, Chuntao & Huang, Wenhui & Zhou, Xingyu & Lv, Chen & Sun, Chao, 2024. "Expert-demonstration-augmented reinforcement learning for lane-change-aware eco-driving traversing consecutive traffic lights," Energy, Elsevier, vol. 286(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:19:p:14452-:d:1253033. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.