IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i14p11084-d1194972.html
   My bibliography  Save this article

An Intelligent Algorithm for Solving Unit Commitments Based on Deep Reinforcement Learning

Author

Listed:
  • Guanglei Huang

    (Shenzhen Power Supply Company, China Southern Power Grid, Shenzhen 518067, China)

  • Tian Mao

    (Electric Power Research Institute, China Southern Power Grid, Guangzhou 510530, China)

  • Bin Zhang

    (Shenzhen Power Supply Company, China Southern Power Grid, Shenzhen 518067, China)

  • Renli Cheng

    (Shenzhen Power Supply Company, China Southern Power Grid, Shenzhen 518067, China)

  • Mingyu Ou

    (Shenzhen Power Supply Company, China Southern Power Grid, Shenzhen 518067, China)

Abstract

With the reform of energy structures, the high proportion of volatile new energy access makes the existing unit commitment (UC) theory unable to satisfy the development demands of day-ahead market decision-making in the new power system. Therefore, this paper proposes an intelligent algorithm for solving UC, based on deep reinforcement learning (DRL) technology. Firstly, the DRL algorithm is used to model the Markov decision process of the UC problem, and the corresponding state space, transfer function, action space and reward function are proposed. Then, the policy gradient (PG) algorithm is used to solve the problem. On this basis, Lambda iteration is used to solve the output scheme of the unit in the start–stop state, and finally a DRL-based UC intelligent solution algorithm is proposed. The applicability and effectiveness of this method are verified based on simulation examples.

Suggested Citation

  • Guanglei Huang & Tian Mao & Bin Zhang & Renli Cheng & Mingyu Ou, 2023. "An Intelligent Algorithm for Solving Unit Commitments Based on Deep Reinforcement Learning," Sustainability, MDPI, vol. 15(14), pages 1-19, July.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:14:p:11084-:d:1194972
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/14/11084/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/14/11084/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Yu, Guangzheng & Liu, Chengquan & Tang, Bo & Chen, Rusi & Lu, Liu & Cui, Chaoyue & Hu, Yue & Shen, Lingxu & Muyeen, S.M., 2022. "Short term wind power prediction for regional wind farms based on spatial-temporal characteristic distribution," Renewable Energy, Elsevier, vol. 199(C), pages 599-612.
    2. Chen, J.J. & Qi, B.X. & Rong, Z.K. & Peng, K. & Zhao, Y.L. & Zhang, X.H., 2021. "Multi-energy coordinated microgrid scheduling with integrated demand response for flexibility improvement," Energy, Elsevier, vol. 217(C).
    3. Huiru Zhao & Yuwei Wang & Sen Guo & Mingrui Zhao & Chao Zhang, 2016. "Application of a Gradient Descent Continuous Actor-Critic Algorithm for Double-Side Day-Ahead Electricity Market Modeling," Energies, MDPI, vol. 9(9), pages 1-20, September.
    4. Fang, Ping & Fu, Wenlong & Wang, Kai & Xiong, Dongzhen & Zhang, Kai, 2022. "A compositive architecture coupling outlier correction, EWT, nonlinear Volterra multi-model fusion with multi-objective optimization for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 307(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhi Zhang & Dan Xu & Xuezhen Chan & Guobin Xu, 2023. "Research on Power System Day-Ahead Generation Scheduling Method Considering Combined Operation of Wind Power and Pumped Storage Power Station," Sustainability, MDPI, vol. 15(7), pages 1-14, April.
    2. Mansour-Saatloo, Amin & Pezhmani, Yasin & Mirzaei, Mohammad Amin & Mohammadi-Ivatloo, Behnam & Zare, Kazem & Marzband, Mousa & Anvari-Moghaddam, Amjad, 2021. "Robust decentralized optimization of Multi-Microgrids integrated with Power-to-X technologies," Applied Energy, Elsevier, vol. 304(C).
    3. Gao, Yang & Ai, Qian & He, Xing & Fan, Songli, 2023. "Coordination for regional integrated energy system through target cascade optimization," Energy, Elsevier, vol. 276(C).
    4. Wang, Liying & Lin, Jialin & Dong, Houqi & Wang, Yuqing & Zeng, Ming, 2023. "Demand response comprehensive incentive mechanism-based multi-time scale optimization scheduling for park integrated energy system," Energy, Elsevier, vol. 270(C).
    5. Haibing Wang & Chengmin Wang & Weiqing Sun & Muhammad Qasim Khan, 2022. "Energy Pricing and Management for the Integrated Energy Service Provider: A Stochastic Stackelberg Game Approach," Energies, MDPI, vol. 15(19), pages 1-15, October.
    6. Liu, Ling & Wang, Jujie & Li, Jianping & Wei, Lu, 2023. "An online transfer learning model for wind turbine power prediction based on spatial feature construction and system-wide update," Applied Energy, Elsevier, vol. 340(C).
    7. Mohseni, Soheil & Brent, Alan C. & Kelly, Scott & Browne, Will N., 2022. "Demand response-integrated investment and operational planning of renewable and sustainable energy systems considering forecast uncertainties: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 158(C).
    8. Huiru Zhao & Yuwei Wang & Mingrui Zhao & Qingkun Tan & Sen Guo, 2017. "Day-Ahead Market Modeling for Strategic Wind Power Producers under Robust Market Clearing," Energies, MDPI, vol. 10(7), pages 1-27, July.
    9. Alexander Kell, 2021. "Modelling the transition to a low-carbon energy supply," Papers 2111.00987, arXiv.org.
    10. Norouzi, Mohammadali & Aghaei, Jamshid & Pirouzi, Sasan & Niknam, Taher & Fotuhi-Firuzabad, Mahmud, 2022. "Flexibility pricing of integrated unit of electric spring and EVs parking in microgrids," Energy, Elsevier, vol. 239(PB).
    11. Lv, Shuaishuai & Wang, Hui & Meng, Xiangping & Yang, Chengdong & Wang, Mingyue, 2022. "Optimal capacity configuration model of power-to-gas equipment in wind-solar sustainable energy systems based on a novel spatiotemporal clustering algorithm: A pathway towards sustainable development," Renewable Energy, Elsevier, vol. 201(P1), pages 240-255.
    12. Chao Tan & Wenrui Tan & Yanjun Shen & Long Yang, 2023. "Multistep Wind Power Prediction Using Time-Varying Filtered Empirical Modal Decomposition and Improved Adaptive Sparrow Search Algorithm-Optimized Phase Space Reconstruction–Echo State Network," Sustainability, MDPI, vol. 15(11), pages 1-17, June.
    13. Saeian, Hosein & Niknam, Taher & Zare, Mohsen & Aghaei, Jamshid, 2022. "Coordinated optimal bidding strategies methods of aggregated microgrids: A game theory-based demand side management under an electricity market environment," Energy, Elsevier, vol. 245(C).
    14. Liu, Jiarui & Fu, Yuchen, 2023. "Decomposition spectral graph convolutional network based on multi-channel adaptive adjacency matrix for renewable energy prediction," Energy, Elsevier, vol. 284(C).
    15. Navid Rezaei & Abdollah Ahmadi & Mohammadhossein Deihimi, 2022. "A Comprehensive Review of Demand-Side Management Based on Analysis of Productivity: Techniques and Applications," Energies, MDPI, vol. 15(20), pages 1-28, October.
    16. Akulker, Handan & Aydin, Erdal, 2023. "Optimal design and operation of a multi-energy microgrid using mixed-integer nonlinear programming: Impact of carbon cap and trade system and taxing on equipment selections," Applied Energy, Elsevier, vol. 330(PA).
    17. Shiping Geng & Gengqi Wu & Caixia Tan & Dongxiao Niu & Xiaopeng Guo, 2021. "Multi-Objective Optimization of a Microgrid Considering the Uncertainty of Supply and Demand," Sustainability, MDPI, vol. 13(3), pages 1-21, January.
    18. Shahbazbegian, Vahid & Shafie-khah, Miadreza & Laaksonen, Hannu & Strbac, Goran & Ameli, Hossein, 2023. "Resilience-oriented operation of microgrids in the presence of power-to-hydrogen systems," Applied Energy, Elsevier, vol. 348(C).
    19. Zhang, M.Y. & Chen, J.J. & Yang, Z.J. & Peng, K. & Zhao, Y.L. & Zhang, X.H., 2021. "Stochastic day-ahead scheduling of irrigation system integrated agricultural microgrid with pumped storage and uncertain wind power," Energy, Elsevier, vol. 237(C).
    20. Zhang, Nan & Feng, Chen & Shan, Yahui & Sun, Na & Xue, Xiaoming & Shi, Liping, 2023. "A universal stability quantification method for grid-connected hydropower plant considering FOPI controller and complex nonlinear characteristics based on improved GWO," Renewable Energy, Elsevier, vol. 211(C), pages 874-894.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:14:p:11084-:d:1194972. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.