IDEAS home Printed from https://ideas.repec.org/a/eee/renene/v201y2022ip1p792-801.html
   My bibliography  Save this article

Optimal scheduling of a wind energy dominated distribution network via a deep reinforcement learning approach

Author

Listed:
  • Zhu, Jiaoyiling
  • Hu, Weihao
  • Xu, Xiao
  • Liu, Haoming
  • Pan, Li
  • Fan, Haoyang
  • Zhang, Zhenyuan
  • Chen, Zhe

Abstract

With the development of clean energy systems, large-scale renewable energy is being connected to the traditional distribution network, which also brings new challenges to the reliable and economic scheduling of the power grid. To address these challenges, this paper proposes an intelligent scheduling strategy for a wind energy dominated distribution network, which aims to reduce the fluctuation caused by the wind energy. First, the energy scheduling model and objective function of the distribution network system are established and the constraints of various types of components are considered. Then, deep reinforcement learning is introduced to realize real-time decision in distribution network to solve the problem of fluctuation caused by the uncertain wind power output. The energy scheduling method is developed into a Markov decision process based on deep deterministic policy gradient (DDPG) algorithm. Finally, the simulation is verified on the IEEE14 node system. The results verify that the proposed approach can effectively reduce power fluctuations in the distribution network. The superiority of the adopted DDPG algorithm is demonstrated by comparing with the deep Q network algorithm.

Suggested Citation

  • Zhu, Jiaoyiling & Hu, Weihao & Xu, Xiao & Liu, Haoming & Pan, Li & Fan, Haoyang & Zhang, Zhenyuan & Chen, Zhe, 2022. "Optimal scheduling of a wind energy dominated distribution network via a deep reinforcement learning approach," Renewable Energy, Elsevier, vol. 201(P1), pages 792-801.
  • Handle: RePEc:eee:renene:v:201:y:2022:i:p1:p:792-801
    DOI: 10.1016/j.renene.2022.10.094
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960148122015968
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.renene.2022.10.094?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xu, Xiao & Hu, Weihao & Cao, Di & Huang, Qi & Chen, Cong & Chen, Zhe, 2020. "Optimized sizing of a standalone PV-wind-hydropower station with pumped-storage installation hybrid energy system," Renewable Energy, Elsevier, vol. 147(P1), pages 1418-1431.
    2. Hua, Haochen & Qin, Yuchao & Hao, Chuantong & Cao, Junwei, 2019. "Optimal energy management strategies for energy Internet via deep reinforcement learning approach," Applied Energy, Elsevier, vol. 239(C), pages 598-609.
    3. Moiseeva, Ekaterina & Wogrin, Sonja & Hesamzadeh, Mohammad Reza, 2017. "Generation flexibility in ramp rates: Strategic behavior and lessons for electricity market design," European Journal of Operational Research, Elsevier, vol. 261(2), pages 755-771.
    4. Malheiro, André & Castro, Pedro M. & Lima, Ricardo M. & Estanqueiro, Ana, 2015. "Integrated sizing and scheduling of wind/PV/diesel/battery isolated systems," Renewable Energy, Elsevier, vol. 83(C), pages 646-657.
    5. Azaza, Maher & Wallin, Fredrik, 2017. "Multi objective particle swarm optimization of hybrid micro-grid system: A case study in Sweden," Energy, Elsevier, vol. 123(C), pages 108-118.
    6. Templeton, J.D. & Hassani, F. & Ghoreishi-Madiseh, S.A., 2016. "Study of effective solar energy storage using a double pipe geothermal heat exchanger," Renewable Energy, Elsevier, vol. 86(C), pages 173-181.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Rekha Guchhait & Biswajit Sarkar, 2023. "Increasing Growth of Renewable Energy: A State of Art," Energies, MDPI, vol. 16(6), pages 1-29, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Islam, M.S. & Das, Barun K. & Das, Pronob & Rahaman, Md Habibur, 2021. "Techno-economic optimization of a zero emission energy system for a coastal community in Newfoundland, Canada," Energy, Elsevier, vol. 220(C).
    2. Rahmat Khezri & Amin Mahmoudi & Hirohisa Aki & S. M. Muyeen, 2021. "Optimal Planning of Remote Area Electricity Supply Systems: Comprehensive Review, Recent Developments and Future Scopes," Energies, MDPI, vol. 14(18), pages 1-29, September.
    3. Xu, Xiao & Hu, Weihao & Du, Yuefang & Liu, Wen & Liu, Zhou & Huang, Qi & Chen, Zhe, 2020. "Robust chance-constrained gas management for a standalone gas supply system based on wind energy," Energy, Elsevier, vol. 212(C).
    4. Adefarati, T. & Bansal, R.C. & Bettayeb, M. & Naidoo, R., 2022. "Technical, economic, and environmental assessment of the distribution power system with the application of renewable energy technologies," Renewable Energy, Elsevier, vol. 199(C), pages 278-297.
    5. Jiaxin Lu & Weijun Wang & Yingchao Zhang & Song Cheng, 2017. "Multi-Objective Optimal Design of Stand-Alone Hybrid Energy System Using Entropy Weight Method Based on HOMER," Energies, MDPI, vol. 10(10), pages 1-17, October.
    6. Bhatt, Ankit & Sharma, M.P. & Saini, R.P., 2016. "Feasibility and sensitivity analysis of an off-grid micro hydro–photovoltaic–biomass and biogas–diesel–battery hybrid energy system for a remote area in Uttarakhand state, India," Renewable and Sustainable Energy Reviews, Elsevier, vol. 61(C), pages 53-69.
    7. Skroufouta, S. & Baltas, E., 2021. "Investigation of hybrid renewable energy system (HRES) for covering energy and water needs on the Island of Karpathos in Aegean Sea," Renewable Energy, Elsevier, vol. 173(C), pages 141-150.
    8. Abdullah Al-Shereiqi & Amer Al-Hinai & Mohammed Albadi & Rashid Al-Abri, 2021. "Optimal Sizing of Hybrid Wind-Solar Power Systems to Suppress Output Fluctuation," Energies, MDPI, vol. 14(17), pages 1-16, August.
    9. Zhang, Yijie & Ma, Tao & Elia Campana, Pietro & Yamaguchi, Yohei & Dai, Yanjun, 2020. "A techno-economic sizing method for grid-connected household photovoltaic battery systems," Applied Energy, Elsevier, vol. 269(C).
    10. Jicheng Liu & Fangqiu Xu & Shuaishuai Lin & Hua Cai & Suli Yan, 2018. "A Multi-Agent-Based Optimization Model for Microgrid Operation Using Dynamic Guiding Chaotic Search Particle Swarm Optimization," Energies, MDPI, vol. 11(12), pages 1-22, November.
    11. Bedoić, Robert & Dorotić, Hrvoje & Schneider, Daniel Rolph & Čuček, Lidija & Ćosić, Boris & Pukšec, Tomislav & Duić, Neven, 2021. "Synergy between feedstock gate fee and power-to-gas: An energy and economic analysis of renewable methane production in a biogas plant," Renewable Energy, Elsevier, vol. 173(C), pages 12-23.
    12. Zeyue Sun & Mohsen Eskandari & Chaoran Zheng & Ming Li, 2022. "Handling Computation Hardness and Time Complexity Issue of Battery Energy Storage Scheduling in Microgrids by Deep Reinforcement Learning," Energies, MDPI, vol. 16(1), pages 1-20, December.
    13. Ren, Fukang & Wei, Ziqing & Zhai, Xiaoqiang, 2021. "Multi-objective optimization and evaluation of hybrid CCHP systems for different building types," Energy, Elsevier, vol. 215(PA).
    14. Davoudkhani, Iraj Faraji & Dejamkhooy, Abdolmajid & Nowdeh, Saber Arabi, 2023. "A novel cloud-based framework for optimal design of stand-alone hybrid renewable energy system considering uncertainty and battery aging," Applied Energy, Elsevier, vol. 344(C).
    15. Vaziri Rad, Mohammad Amin & Kasaeian, Alibakhsh & Niu, Xiaofeng & Zhang, Kai & Mahian, Omid, 2023. "Excess electricity problem in off-grid hybrid renewable energy systems: A comprehensive review from challenges to prevalent solutions," Renewable Energy, Elsevier, vol. 212(C), pages 538-560.
    16. Devine, Mel T. & Siddiqui, Sauleh, 2023. "Strategic investment decisions in an oligopoly with a competitive fringe: An equilibrium problem with equilibrium constraints approach," European Journal of Operational Research, Elsevier, vol. 306(3), pages 1473-1494.
    17. Fathy, Ahmed, 2023. "Bald eagle search optimizer-based energy management strategy for microgrid with renewable sources and electric vehicles," Applied Energy, Elsevier, vol. 334(C).
    18. Naderipour, Amirreza & Ramtin, Amir Reza & Abdullah, Aldrin & Marzbali, Massoomeh Hedayati & Nowdeh, Saber Arabi & Kamyab, Hesam, 2022. "Hybrid energy system optimization with battery storage for remote area application considering loss of energy probability and economic analysis," Energy, Elsevier, vol. 239(PD).
    19. Hugo Algarvio & Fernando Lopes & António Couto & Ana Estanqueiro & João Santana, 2019. "Variable Renewable Energy and Market Design: New Products and a Real-World Study," Energies, MDPI, vol. 12(23), pages 1-17, November.
    20. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:renene:v:201:y:2022:i:p1:p:792-801. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/renewable-energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.