IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i21p4563-d1275169.html
   My bibliography  Save this article

A Novel Two-Stage, Dual-Layer Distributed Optimization Operational Approach for Microgrids with Electric Vehicles

Author

Listed:
  • Bowen Zhou

    (College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
    Key Laboratory of Integrated Energy Optimization and Secure Operation of Liaoning Province, Northeastern University, Shenyang 110819, China)

  • Zhibo Zhang

    (College of Information Science and Engineering, Northeastern University, Shenyang 110819, China
    Key Laboratory of Integrated Energy Optimization and Secure Operation of Liaoning Province, Northeastern University, Shenyang 110819, China)

  • Chao Xi

    (State Grid Harbin Power Supply Company, Harbin 150001, China)

  • Boyu Liu

    (School of Electrical Engineering and Telecommunications, UNSW Sydney, Sydney, NSW 2052, Australia)

Abstract

As the ownership of electric vehicles (EVs) continues to rise, EVs are becoming an integral part of urban microgrids. Incorporating the charging and discharging processes of EVs into the microgrid’s optimization scheduling process can serve to load leveling, reducing the reliance of the microgrid on external power networks. This paper proposes a novel two-stage, dual-layer distributed optimization operational approach for microgrids with EVs. The lower layer is a distributed control layer, which ensures, through consensus control methods, that every EV maintains a consistent charging/discharging and state of charge (SOC). The upper layer is the optimization scheduling layer, determining the optimal operational strategy of the microgrid using the multiagent reinforcement learning method and providing control reference signals for the lower layer. Additionally, this paper categorizes the charging process of EVs into two stages based on their SOC: the constrained scheduling stage and the free scheduling stage. By employing distinct control methods during these two stages, we ensure that EVs can participate in the microgrid scheduling while fully respecting the charging interests of the EV owners.

Suggested Citation

  • Bowen Zhou & Zhibo Zhang & Chao Xi & Boyu Liu, 2023. "A Novel Two-Stage, Dual-Layer Distributed Optimization Operational Approach for Microgrids with Electric Vehicles," Mathematics, MDPI, vol. 11(21), pages 1-33, November.
    • Handle: RePEc:gam:jmathe:v:11:y:2023:i:21:p:4563-:d:1275169
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/21/4563/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/11/21/4563/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Guo, Shiliang & Li, Pengpeng & Ma, Kai & Yang, Bo & Yang, Jie, 2022. "Robust energy management for industrial microgrid considering charging and discharging pressure of electric vehicles," Applied Energy, Elsevier, vol. 325(C).
    2. Wang, Yubin & Dong, Wei & Yang, Qiang, 2022. "Multi-stage optimal energy management of multi-energy microgrid in deregulated electricity markets," Applied Energy, Elsevier, vol. 310(C).
    3. Shi, Mengshu & Huang, Yuansheng & Lin, Hongyu, 2023. "Research on power to hydrogen optimization and profit distribution of microgrid cluster considering shared hydrogen storage," Energy, Elsevier, vol. 264(C).
    4. Guo, Chenyu & Wang, Xin & Zheng, Yihui & Zhang, Feng, 2022. "Real-time optimal energy management of microgrid with uncertainties based on deep reinforcement learning," Energy, Elsevier, vol. 238(PC).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Li, Yonggang & Su, Yaotong & Zhang, Yuanjin & Wu, Weinong & Xia, Lei, 2024. "Two-layered optimal scheduling under a semi-model architecture of hydro-wind-solar multi-energy systems with hydrogen storage," Energy, Elsevier, vol. 313(C).
    2. Amine, Hartani Mohamed & Aissa, Benhammou & Rezk, Hegazy & Messaoud, Hamouda & Othmane, Adbdelkhalek & Saad, Mekhilef & Abdelkareem, Mohammad Ali, 2023. "Enhancing hybrid energy storage systems with advanced low-pass filtration and frequency decoupling for optimal power allocation and reliability of cluster of DC-microgrids," Energy, Elsevier, vol. 282(C).
    3. Lu, Yu & Xiang, Yue & Huang, Yuan & Yu, Bin & Weng, Liguo & Liu, Junyong, 2023. "Deep reinforcement learning based optimal scheduling of active distribution system considering distributed generation, energy storage and flexible load," Energy, Elsevier, vol. 271(C).
    4. Wang, Yi & Qiu, Dawei & Sun, Mingyang & Strbac, Goran & Gao, Zhiwei, 2023. "Secure energy management of multi-energy microgrid: A physical-informed safe reinforcement learning approach," Applied Energy, Elsevier, vol. 335(C).
    5. Moradi, Amir & Salehi, Javad & Shafie-khah, Miadreza, 2024. "An interactive framework for strategic participation of a price-maker energy hub in the local gas and power markets based on the MPEC method," Energy, Elsevier, vol. 307(C).
    6. Tan, Bifei & Chen, Simin & Liang, Zipeng & Zheng, Xiaodong & Zhu, Yanjin & Chen, Haoyong, 2024. "An iteration-free hierarchical method for the energy management of multiple-microgrid systems with renewable energy sources and electric vehicles," Applied Energy, Elsevier, vol. 356(C).
    7. Tan, Bifei & Lin, Zhenjia & Zheng, Xiaodong & Xiao, Fu & Wu, Qiuwei & Yan, Jinyue, 2023. "Distributionally robust energy management for multi-microgrids with grid-interactive EVs considering the multi-period coupling effect of user behaviors," Applied Energy, Elsevier, vol. 350(C).
    8. Lan, Penghang & Chen, She & Li, Qihang & Li, Kelin & Wang, Feng & Zhao, Yaoxun, 2024. "Intelligent hydrogen-ammonia combined energy storage system with deep reinforcement learning," Renewable Energy, Elsevier, vol. 237(PB).
    9. Dong, Xiao-Jian & Shen, Jia-Ni & Ma, Zi-Feng & He, Yi-Jun, 2025. "Stochastic optimization of integrated electric vehicle charging stations under photovoltaic uncertainty and battery power constraints," Energy, Elsevier, vol. 314(C).
    10. Zhang, Tairan & Sobhani, Behrouz, 2023. "Optimal economic programming of an energy hub in the power system while taking into account the uncertainty of renewable resources, risk-taking and electric vehicles using a developed routing method," Energy, Elsevier, vol. 271(C).
    11. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    12. Zhang, Yiwen & Lin, Rui & Mei, Zhen & Lyu, Minghao & Jiang, Huaiguang & Xue, Ying & Zhang, Jun & Gao, David Wenzhong, 2024. "Interior-point policy optimization based multi-agent deep reinforcement learning method for secure home energy management under various uncertainties," Applied Energy, Elsevier, vol. 376(PA).
    13. Julian Koch & Astrid Bensmann & Christoph Eckert & Michael Rath & Richard Hanke-Rauschenbach, 2024. "Planning of Reserve Storage to Compensate for Forecast Errors," Energies, MDPI, vol. 17(3), pages 1-16, February.
    14. Gerald Jones & Xueping Li & Yulin Sun, 2024. "Robust Energy Management Policies for Solar Microgrids via Reinforcement Learning," Energies, MDPI, vol. 17(12), pages 1-22, June.
    15. Pinciroli, Luca & Baraldi, Piero & Compare, Michele & Zio, Enrico, 2023. "Optimal operation and maintenance of energy storage systems in grid-connected microgrids by deep reinforcement learning," Applied Energy, Elsevier, vol. 352(C).
    16. Yao, Wenliang & Wang, Chengfu & Yang, Ming & Wang, Kang & Dong, Xiaoming & Zhang, Zhenwei, 2023. "A tri-layer decision-making framework for IES considering the interaction of integrated demand response and multi-energy market clearing," Applied Energy, Elsevier, vol. 342(C).
    17. Li, Jinpeng & Xu, Yinliang & Zhang, Junxiao & Gao, Chong & Sun, Hongbin, 2025. "Distributed EV scheduling in distribution networks with reserve market participation under ambiguous probability distribution," Applied Energy, Elsevier, vol. 383(C).
    18. Zhang, Y.Q. & Chen, J.J. & Wang, Y.X. & Feng, L., 2024. "Enhancing resilience of agricultural microgrid through electricity–heat–water based multi-energy hub considering irradiation intensity uncertainty," Renewable Energy, Elsevier, vol. 220(C).
    19. Bio Gassi, Karim & Baysal, Mustafa, 2023. "Improving real-time energy decision-making model with an actor-critic agent in modern microgrids with energy storage devices," Energy, Elsevier, vol. 263(PE).
    20. Zhu, Dafeng & Yang, Bo & Liu, Yuxiang & Wang, Zhaojian & Ma, Kai & Guan, Xinping, 2022. "Energy management based on multi-agent deep reinforcement learning for a multi-energy industrial park," Applied Energy, Elsevier, vol. 311(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:21:p:4563-:d:1275169. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.