IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i18p4941-d1751277.html

Design of Robust Adaptive Nonlinear Backstepping Controller Enhanced by Deep Deterministic Policy Gradient Algorithm for Efficient Power Converter Regulation

Author

Listed:
  • Seyyed Morteza Ghamari

    (School of Engineering, Edith Cowan University, Joondalup 6027, Australia)

  • Asma Aziz

    (School of Engineering, Edith Cowan University, Joondalup 6027, Australia)

  • Mehrdad Ghahramani

    (School of Engineering, Edith Cowan University, Joondalup 6027, Australia)

Abstract

Power converters play an important role in incorporating renewable energy sources into power systems. Among different converter designs, Buck and Boost converters are popular, as they use fewer components and deliver cost savings and high efficiency. However, Boost converters are known as non–minimum phase systems, imposing harder constraints for designing a robust converter. Developing an efficient controller for these topologies can be difficult since they exhibit nonlinearity and distortion in high frequency modes. The Lyapunov-based Adaptive Backstepping Control (ABSC) technology is used to regulate suitable outputs for these structures. This approach is an updated version of the technique that uses the stability Lyapunov function to produce increased stability and resistance to fluctuations in real-world circumstances. However, in real-time situations, disturbances with larger ranges such as supply voltage changes, parameter variations, and noise may have a negative impact on the operation of this strategy. To increase the controller’s flexibility under more difficult working settings, the most appropriate first gains must be established. To solve these concerns, the ABSC’s performance is optimized using the Reinforcement Learning (RL) adaptive technique. RL has several advantages, including lower susceptibility to error, more trustworthy findings obtained from data gathering from the environment, perfect model behavior within a certain context, and better frequency matching in real-time applications. Random exploration, on the other hand, can have disastrous effects and produce unexpected results in real-world situations. As a result, we choose the Deep Deterministic Policy Gradient (DDPG) approach, which uses a deterministic action function rather than a stochastic one. Its key advantages include effective handling of continuous action spaces, improved sample efficiency through off-policy learning, and faster convergence via its actor–critic architecture that balances value estimation and policy optimization. Furthermore, this technique uses the Grey Wolf Optimization (GWO) algorithm to improve the initial set of gains, resulting in more reliable outcomes and quicker dynamics. The GWO technique is notable for its disciplined and nature-inspired approach, which leads to faster decision-making and greater accuracy than other optimization methods. This method considers the system as a black box without its exact mathematical modeling, leading to lower complexity and computational burden. The effectiveness of this strategy is tested in both modeling and experimental scenarios utilizing the Hardware-In-Loop (HIL) framework, with considerable results and decreased error sensitivity.

Suggested Citation

  • Seyyed Morteza Ghamari & Asma Aziz & Mehrdad Ghahramani, 2025. "Design of Robust Adaptive Nonlinear Backstepping Controller Enhanced by Deep Deterministic Policy Gradient Algorithm for Efficient Power Converter Regulation," Energies, MDPI, vol. 18(18), pages 1-27, September.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:18:p:4941-:d:1751277
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/18/4941/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/18/4941/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ahmed M. Nassef & Mohammad Ali Abdelkareem & Hussein M. Maghrabie & Ahmad Baroutaji, 2023. "Review of Metaheuristic Optimization Algorithms for Power Systems Problems," Sustainability, MDPI, vol. 15(12), pages 1-27, June.
    2. Cheng, Hangyu & Jung, Seunghun & Kim, Young-Bae, 2025. "A novel reinforcement learning controller for the DC-DC boost converter," Energy, Elsevier, vol. 321(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Shree Om Bade & Olusegun Stanley Tomomewo & Ajan Meenakshisundaram & Maharshi Dey & Moones Alamooti & Nabil Halwany, 2025. "Multi-Criteria Optimization of a Hybrid Renewable Energy System Using Particle Swarm Optimization for Optimal Sizing and Performance Evaluation," Clean Technol., MDPI, vol. 7(1), pages 1-31, March.
    2. Olympia Roeva & Dafina Zoteva & Gergana Roeva & Maya Ignatova & Velislava Lyubenova, 2024. "An Effective Hybrid Metaheuristic Approach Based on the Genetic Algorithm," Mathematics, MDPI, vol. 12(23), pages 1-16, December.
    3. Kaoud, Omar G. & Elbassoussi, Muhammad H. & Abido, M.A. & Zubair, Syed M., 2026. "Optimized solar and wind-powered RO systems for sustainable water solutions in Sinai resorts using different optimization techniques," Renewable Energy, Elsevier, vol. 257(C).
    4. Shuxin Liu & Jing Xu & Chaojian Xing & Yang Liu & Ersheng Tian & Jia Cui & Junzhu Wei, 2023. "Study on Dynamic Pricing Strategy for Industrial Power Users Considering Demand Response Differences in Master–Slave Game," Sustainability, MDPI, vol. 15(16), pages 1-21, August.
    5. Mateusz Malarczyk & Grzegorz Kaczmarczyk & Jaroslaw Szrek & Marcin Kaminski, 2023. "Internet of Robotic Things (IoRT) and Metaheuristic Optimization Techniques Applied for Wheel-Legged Robot," Future Internet, MDPI, vol. 15(9), pages 1-19, September.
    6. Farhat Nasim & Shahida Khatoon & Ibraheem & Shabana Urooj & Mohammad Shahid & Asmaa Ali & Nidal Nasser, 2025. "Hybrid ANFIS-PI-Based Optimization for Improved Power Conversion in DFIG Wind Turbine," Sustainability, MDPI, vol. 17(6), pages 1-22, March.
    7. Pan Yu & Hui Wan & Bozhi Zhang & Qiang Wu & Bohao Zhao & Chen Xu & Shangbin Yang, 2025. "Review on System Identification, Control, and Optimization Based on Artificial Intelligence," Mathematics, MDPI, vol. 13(6), pages 1-22, March.
    8. Ye, Jian & Xuan, Weiye & Guo, Qi & Liu, Yun & Wang, Benfei & Zhang, Xinan & Iu, Herbert Ho Ching, 2026. "An overview of reinforcement learning for power electronic converters: Topology derivation, parameter design, and control implementation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 228(C).
    9. Mohammed Qasim Taha & Sefer Kurnaz, 2023. "Droop Control Optimization for Improved Power Sharing in AC Islanded Microgrids Based on Centripetal Force Gravity Search Algorithm," Energies, MDPI, vol. 16(24), pages 1-20, December.
    10. Ebrie, Awol Seid & Kim, Young Jin, 2024. "Reinforcement learning-based optimization for power scheduling in a renewable energy connected grid," Renewable Energy, Elsevier, vol. 230(C).
    11. Jorge Muñoz & Luis Tipán & Cristian Cuji & Manuel Jaramillo, 2025. "Resilient Distribution System Reconfiguration Based on Genetic Algorithms Considering Load Margin and Contingencies," Energies, MDPI, vol. 18(11), pages 1-22, May.
    12. Zhe Wang & Jiali Duan & Fengzhang Luo & Xuan Wu, 2024. "Two-Stage Optimal Scheduling for Urban Snow-Shaped Distribution Network Based on Coordination of Source-Network-Load-Storage," Energies, MDPI, vol. 17(14), pages 1-22, July.
    13. Hegazy Rezk & Usama Hamed Issa & Anas Bouaouda & Fatma A. Hashim, 2025. "A Novel Improved Gradient‐Based Optimizer for Single‐Sensor Global MPPT of PV System," Journal of Mathematics, John Wiley & Sons, vol. 2025(1).
    14. Turner, I. & Bamber, N. & Andrews, J. & Pelletier, N., 2025. "Systematic review of the life cycle optimization literature, and recommendations for performance of life cycle optimization studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 208(C).
    15. Chia-Hung Wang & Kun Hu & Xiaojing Wu & Yufeng Ou, 2025. "Rethinking Metaheuristics: Unveiling the Myth of “Novelty” in Metaheuristic Algorithms," Mathematics, MDPI, vol. 13(13), pages 1-28, July.
    16. Umar Draz & Tariq Ali & Sana Yasin & Muhammad Hasanain Chaudary & Muhammad Ayaz & El-Hadi M. Aggoune & Isha Yasin, 2024. "Hybridization and Optimization of Bio and Nature-Inspired Metaheuristic Techniques of Beacon Nodes Scheduling for Localization in Underwater IoT Networks," Mathematics, MDPI, vol. 12(22), pages 1-29, November.
    17. Muhammad Usman Riaz & Suheel Abdullah Malik & Amil Daraz & Hasan Alrajhi & Ahmed N. M. Alahmadi & Abdul Rahman Afzal, 2024. "Advanced Energy Management in a Sustainable Integrated Hybrid Power Network Using a Computational Intelligence Control Strategy," Energies, MDPI, vol. 17(20), pages 1-53, October.
    18. Mohammed Goda Eisa & Mohammed A. Farahat & Wael Abdelfattah & Mohammed Elsayed Lotfy, 2024. "Multi-Objective Optimal Integration of Distributed Generators into Distribution Networks Incorporated with Plug-In Electric Vehicles Using Walrus Optimization Algorithm," Sustainability, MDPI, vol. 16(22), pages 1-37, November.
    19. Palomba, Valeria & Bonanno, Antonino & Brunaccini, Giovanni & Costa, Fabio & La Rosa, Davide & Frazzica, Andrea, 2025. "Experimental proof of a model-based real-time control of adsorption chillers," Energy, Elsevier, vol. 328(C).
    20. Cheng, Hangyu & Chen, Jiahui & Jung, Seunghun & Kim, Young-Bae, 2025. "Hierarchical rolling optimization strategy for hybrid electric-hydrogen system based on deep reinforcement learning," Energy, Elsevier, vol. 338(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:18:p:4941-:d:1751277. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.