IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v14y2021i16p4804-d610068.html
   My bibliography  Save this article

Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic

Author

Listed:
  • Yuemin Zheng

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Jin Tao

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China
    Department of Electrical Engineering and Automation, Aalto University, 02150 Espoo, Finland)

  • Hao Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Qinglin Sun

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China)

  • Zengqiang Chen

    (College of Artificial Intelligence, Nankai University, Tianjin 300350, China
    Key Laboratory of Intelligent Robotics of Tianjin, Nankai University, Tianjin 300350, China)

  • Matthias Dehmer

    (Department of Computer Science, Swiss Distance University of Applied Sciences, 3900 Brig, Switzerland)

  • Quan Zhou

    (Department of Electrical Engineering and Automation, Aalto University, 02150 Espoo, Finland)

Abstract

To ensure the safe operation of an interconnected power system, it is necessary to maintain the stability of the frequency and the tie-line exchanged power. This is one of the hottest issues in the power system field and is usually called load frequency control. To overcome the influences of load disturbances on multi-source power systems containing thermal power plants, hydropower plants, and gas turbine plants, we design a linear active disturbance rejection control (LADRC) based on the tie-line bias control mode. For LADRC, the parameter selection of the controller directly affects the response performance of the entire system, and it is usually not feasible to manually adjust parameters. Therefore, to obtain the optimal controller parameters, we use the Soft Actor-Critic algorithm in reinforcement learning to obtain the controller parameters in real time, and we design the reward function according to the needs of the power system. We carry out simulation experiments to verify the effectiveness of the proposed method. Compared with the results of other proportional–integral–derivative control techniques using optimization algorithms and LADRC with constant parameters, the proposed method shows significant advantages in terms of overshoot, undershoot, and settling time. In addition, by adding different disturbances to different areas of the multi-source power system, we demonstrate the robustness of the proposed control strategy.

Suggested Citation

  • Yuemin Zheng & Jin Tao & Hao Sun & Qinglin Sun & Zengqiang Chen & Matthias Dehmer & Quan Zhou, 2021. "Load Frequency Active Disturbance Rejection Control for Multi-Source Power System Based on Soft Actor-Critic," Energies, MDPI, vol. 14(16), pages 1-17, August.
    • Handle: RePEc:gam:jeners:v:14:y:2021:i:16:p:4804-:d:610068
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/14/16/4804/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/14/16/4804/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Assareh, E. & Behrang, M.A. & Assari, M.R. & Ghanbarzadeh, A., 2010. "Application of PSO (particle swarm optimization) and GA (genetic algorithm) techniques on demand estimation of oil in Iran," Energy, Elsevier, vol. 35(12), pages 5223-5229.
    2. Guo-Qiang Zeng & Xiao-Qing Xie & Min-Rong Chen, 2017. "An Adaptive Model Predictive Load Frequency Control Method for Multi-Area Interconnected Power Systems with Photovoltaic Generations," Energies, MDPI, vol. 10(11), pages 1-23, November.
    3. Ana Fernández-Guillamón & Guillermo Martínez-Lucas & Ángel Molina-García & Jose Ignacio Sarasua, 2020. "An Adaptive Control Scheme for Variable Speed Wind Turbines Providing Frequency Regulation in Isolated Power Systems with Thermal Generation," Energies, MDPI, vol. 13(13), pages 1-19, July.
    4. Kyoungboo Yang & Kyungho Cho, 2019. "Simulated Annealing Algorithm for Wind Farm Layout Optimization: A Benchmark Study," Energies, MDPI, vol. 12(23), pages 1-15, November.
    5. Liu, Jizhen & Yao, Qi & Hu, Yang, 2019. "Model predictive control for load frequency of hybrid power system with wind power and thermal power," Energy, Elsevier, vol. 172(C), pages 555-565.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Atul Anand & L Suganthi, 2018. "Hybrid GA-PSO Optimization of Artificial Neural Network for Forecasting Electricity Demand," Energies, MDPI, vol. 11(4), pages 1-15, March.
    2. Zhu, Yongbin & Shi, Yajuan & Wang, Zheng, 2014. "How much CO2 emissions will be reduced through industrial structure change if China focuses on domestic rather than international welfare?," Energy, Elsevier, vol. 72(C), pages 168-179.
    3. Tania García-Sánchez & Arbinda Kumar Mishra & Elías Hurtado-Pérez & Rubén Puché-Panadero & Ana Fernández-Guillamón, 2020. "A Controller for Optimum Electrical Power Extraction from a Small Grid-Interconnected Wind Turbine," Energies, MDPI, vol. 13(21), pages 1-16, November.
    4. Penghui Qiang & Peng Wu & Tao Pan & Huaiquan Zang, 2021. "Real-Time Approximate Equivalent Consumption Minimization Strategy Based on the Single-Shaft Parallel Hybrid Powertrain," Energies, MDPI, vol. 14(23), pages 1-22, November.
    5. Ke, Ming-Tsun & Yeh, Chia-Hung & Su, Cheng-Jie, 2017. "Cloud computing platform for real-time measurement and verification of energy performance," Applied Energy, Elsevier, vol. 188(C), pages 497-507.
    6. Kaleem Ullah & Abdul Basit & Zahid Ullah & Sheraz Aslam & Herodotos Herodotou, 2021. "Automatic Generation Control Strategies in Conventional and Modern Power Systems: A Comprehensive Overview," Energies, MDPI, vol. 14(9), pages 1-43, April.
    7. Askarzadeh, Alireza, 2014. "Comparison of particle swarm optimization and other metaheuristics on electricity demand estimation: A case study of Iran," Energy, Elsevier, vol. 72(C), pages 484-491.
    8. Babak Mohammadi & Farshad Ahmadi & Saeid Mehdizadeh & Yiqing Guan & Quoc Bao Pham & Nguyen Thi Thuy Linh & Doan Quang Tri, 2020. "Developing Novel Robust Models to Improve the Accuracy of Daily Streamflow Modeling," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 34(10), pages 3387-3409, August.
    9. Uzlu, Ergun & Akpınar, Adem & Özturk, Hasan Tahsin & Nacar, Sinan & Kankal, Murat, 2014. "Estimates of hydroelectric generation using neural networks with the artificial bee colony algorithm for Turkey," Energy, Elsevier, vol. 69(C), pages 638-647.
    10. Ma, Weimin & Zhu, Xiaoxi & Wang, Miaomiao, 2013. "Forecasting iron ore import and consumption of China using grey model optimized by particle swarm optimization algorithm," Resources Policy, Elsevier, vol. 38(4), pages 613-620.
    11. Muhammad Nabeel Hussain & Nadeem Shaukat & Ammar Ahmad & Muhammad Abid & Abrar Hashmi & Zohreh Rajabi & Muhammad Atiq Ur Rehman Tariq, 2022. "Micro-Siting of Wind Turbines in an Optimal Wind Farm Area Using Teaching–Learning-Based Optimization Technique," Sustainability, MDPI, vol. 14(14), pages 1-24, July.
    12. Younes, Mimoun & Khodja, Fouad & Kherfane, Riad Lakhdar, 2014. "Multi-objective economic emission dispatch solution using hybrid FFA (firefly algorithm) and considering wind power penetration," Energy, Elsevier, vol. 67(C), pages 595-606.
    13. Danny Ochoa & Sergio Martinez, 2021. "Analytical Approach to Understanding the Effects of Implementing Fast-Frequency Response by Wind Turbines on the Short-Term Operation of Power Systems," Energies, MDPI, vol. 14(12), pages 1-22, June.
    14. Ana Fernández-Guillamón & Antonio Vigueras-Rodríguez & Emilio Gómez-Lázaro & Ángel Molina-García, 2018. "Fast Power Reserve Emulation Strategy for VSWT Supporting Frequency Control in Multi-Area Power Systems," Energies, MDPI, vol. 11(10), pages 1-20, October.
    15. Wang, Bo & Wang, Shuming & Zhou, Xianzhong & Watada, Junzo, 2016. "Multi-objective unit commitment with wind penetration and emission concerns under stochastic and fuzzy uncertainties," Energy, Elsevier, vol. 111(C), pages 18-31.
    16. Hamed Bagheri & Mohammadali Behrang & Ehsanolah Assareh & Mohsen Izadi & Mikhail A. Sheremet, 2019. "Free Convection of Hybrid Nanofluids in a C-Shaped Chamber under Variable Heat Flux and Magnetic Field: Simulation, Sensitivity Analysis, and Artificial Neural Networks," Energies, MDPI, vol. 12(14), pages 1-17, July.
    17. Izadyar, Nima & Ghadamian, Hossein & Ong, Hwai Chyuan & moghadam, Zeinab & Tong, Chong Wen & Shamshirband, Shahaboddin, 2015. "Appraisal of the support vector machine to forecast residential heating demand for the District Heating System based on the monthly overall natural gas consumption," Energy, Elsevier, vol. 93(P2), pages 1558-1567.
    18. Mehdi Seraj & Pejman Bahramian & Abdulkareem Alhassan & Rasool Dehghanzadeh Shahabad, 2020. "The validity of Rodrik’s conclusion on real exchange rate and economic growth: factor priority evidence from feature selection approach," Palgrave Communications, Palgrave Macmillan, vol. 6(1), pages 1-6, December.
    19. Kong, Xiaobing & Abdelbaky, Mohamed Abdelkarim & Liu, Xiangjie & Lee, Kwang Y., 2023. "Stable feedback linearization-based economic MPC scheme for thermal power plant," Energy, Elsevier, vol. 268(C).
    20. Mahmut Temel ÖZDEMİR & Dursun ÖZTÜRK, 2017. "Comparative Performance Analysis of Optimal PID Parameters Tuning Based on the Optics Inspired Optimization Methods for Automatic Generation Control," Energies, MDPI, vol. 10(12), pages 1-19, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:14:y:2021:i:16:p:4804-:d:610068. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.