IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v377y2025ipbs0306261924017343.html
   My bibliography  Save this article

Sequential service restoration with grid-interactive flexibility from building AC systems for resilient microgrids under endogenous and exogenous uncertainties

Author

Listed:
  • Ma, Cheng
  • Lei, Shunbo
  • Chen, Dong
  • Wang, Chong
  • Hatziargyriou, Nikos D.
  • Song, Ziyou

Abstract

Microgrids can operate in island mode and can restore critical loads utilizing renewable energy sources (RESs) after natural disasters. Yet, the uncertainty of RESs poses a significant challenge to their participation in the microgrid sequential service restoration (SR) process. Air conditioning (AC) systems with building thermal inertia can provide grid-interactive flexibility by pre-cooling or pre-heating strategies while satisfying occupants’ comfort level, and are ideal resources to handle uncertain renewable generation. However, endogenous uncertainty which captures uncertain time-varying grid-interactive flexibility realization of building AC systems affected by load pickup decisions, together with exogenous uncertainty from renewable generation, load demand, and outdoor ambient temperature make the problem hard to solve. To address above-mentioned challenges, a deep reinforcement learning-based (DRL) resilient microgrid SR approach coordinating high penetration of RESs and grid-interactive flexibility from building AC systems is proposed in this work. The microgrid SR problem is reformulated as a Markov decision process (MDP) and addressed with an improved twin delayed deep deterministic policy gradient-based (TD3) microgrid SR algorithm. The proposed microgrid SR approach is verified on the IEEE 33-node and 123-node systems. Comprehensive numerical results demonstrate that the proposed microgrid SR strategy with grid-interactive flexibility from building AC systems can attain superior performance in terms of restoration performance indices.

Suggested Citation

  • Ma, Cheng & Lei, Shunbo & Chen, Dong & Wang, Chong & Hatziargyriou, Nikos D. & Song, Ziyou, 2025. "Sequential service restoration with grid-interactive flexibility from building AC systems for resilient microgrids under endogenous and exogenous uncertainties," Applied Energy, Elsevier, vol. 377(PB).
    • Handle: RePEc:eee:appene:v:377:y:2025:i:pb:s0306261924017343
    DOI: 10.1016/j.apenergy.2024.124351
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261924017343
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2024.124351?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mu, Yunfei & Xu, Yanze & Zhang, Jiarui & Wu, Zeqing & Jia, Hongjie & Jin, Xiaolong & Qi, Yan, 2023. "A data-driven rolling optimization control approach for building energy systems that integrate virtual energy storage systems," Applied Energy, Elsevier, vol. 346(C).
    2. Nilay Noyan & Gábor Rudolf & Miguel Lejeune, 2022. "Distributionally Robust Optimization Under a Decision-Dependent Ambiguity Set with Applications to Machine Scheduling and Humanitarian Logistics," INFORMS Journal on Computing, INFORMS, vol. 34(2), pages 729-751, March.
    3. Sun, Fangyuan & Kong, Xiangyu & Wu, Jianzhong & Gao, Bixuan & Chen, Ke & Lu, Ning, 2022. "DSM pricing method based on A3C and LSTM under cloud-edge environment," Applied Energy, Elsevier, vol. 315(C).
    4. Song, Meng & Deng, Rongnan & Yan, Xingyu & Sun, Wei & Gao, Ciwei & Yan, Mingyu & Ban, Mingfei & Xia, Shiwei, 2024. "Two-stage decision-dependent demand response driven by TCLs for distribution system resilience enhancement," Applied Energy, Elsevier, vol. 361(C).
    5. Mota, Bruno & Faria, Pedro & Vale, Zita, 2024. "Energy cost optimization through load shifting in a photovoltaic energy-sharing household community," Renewable Energy, Elsevier, vol. 221(C).
    6. Bao, Yi & Xu, Jian & Feng, Wei & Sun, Yuanzhang & Liao, Siyang & Yin, Rongxin & Jiang, Yazhou & Jin, Ming & Marnay, Chris, 2019. "Provision of secondary frequency regulation by coordinated dispatch of industrial loads and thermal power plants," Applied Energy, Elsevier, vol. 241(C), pages 302-312.
    7. Villanueva-Rosario, Junior Alexis & Santos-García, Félix & Aybar-Mejía, Miguel Euclides & Mendoza-Araya, Patricio & Molina-García, Angel, 2022. "Coordinated ancillary services, market participation and communication of multi-microgrids: A review," Applied Energy, Elsevier, vol. 308(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Chong & Wang, Qi & Xiang, Xi & Zhang, Canrong & Miao, Lixin, 2025. "Optimizing integrated berth allocation and quay crane assignment: A distributionally robust approach," European Journal of Operational Research, Elsevier, vol. 320(3), pages 593-615.
    2. Xin Ding & Sujie Zhang, 2024. "A Coordinated Emergency Frequency Control Strategy Based on Output Regulation Approach for an Isolated Industrial Microgrid," Energies, MDPI, vol. 17(20), pages 1-20, October.
    3. Gao, Bixuan & Kong, Xiangyu & Li, Shangze & Chen, Yi & Zhang, Xiyuan & Liu, Ziyu & Lv, Weijia, 2024. "Enhancing anomaly detection accuracy and interpretability in low-quality and class imbalanced data: A comprehensive approach," Applied Energy, Elsevier, vol. 353(PB).
    4. Lu, Renzhi & Bai, Ruichang & Ding, Yuemin & Wei, Min & Jiang, Junhui & Sun, Mingyang & Xiao, Feng & Zhang, Hai-Tao, 2021. "A hybrid deep learning-based online energy management scheme for industrial microgrid," Applied Energy, Elsevier, vol. 304(C).
    5. Xu, Jiazhu & Yi, Yuqin, 2023. "Multi-microgrid low-carbon economy operation strategy considering both source and load uncertainty: A Nash bargaining approach," Energy, Elsevier, vol. 263(PB).
    6. Hirwa, Jusse & Zolan, Alexander & Becker, William & Flamand, Tülay & Newman, Alexandra, 2023. "Optimizing design and dispatch of a resilient renewable energy microgrid for a South African hospital," Applied Energy, Elsevier, vol. 348(C).
    7. Dagoberto Martinez-Polo & David Romero-Quete & Camilo A. Cortes, 2024. "Consumer Theory-Based Primary Frequency Regulation in Multi-Microgrid Systems within a P2P Energy Management Framework," Sustainability, MDPI, vol. 16(15), pages 1-22, August.
    8. Chang, Weiguang & Yang, Qiang, 2023. "Low carbon oriented collaborative energy management framework for multi-microgrid aggregated virtual power plant considering electricity trading," Applied Energy, Elsevier, vol. 351(C).
    9. Joel Alpízar-Castillo & Laura Ramirez-Elizondo & Pavol Bauer, 2022. "Assessing the Role of Energy Storage in Multiple Energy Carriers toward Providing Ancillary Services: A Review," Energies, MDPI, vol. 16(1), pages 1-31, December.
    10. Islam, Md. Zahidul & Lin, Yuzhang & Vokkarane, Vinod M. & Yu, Nanpeng, 2023. "Robust learning-based real-time load estimation using sparsely deployed smart meters with high reporting rates," Applied Energy, Elsevier, vol. 352(C).
    11. Mohammed M. Alhaider & Ziad M. Ali & Mostafa H. Mostafa & Shady H. E. Abdel Aleem, 2023. "Economic Viability of NaS Batteries for Optimal Microgrid Operation and Hosting Capacity Enhancement under Uncertain Conditions," Sustainability, MDPI, vol. 15(20), pages 1-24, October.
    12. Mudhafar Al-Saadi & Maher Al-Greer & Michael Short, 2023. "Reinforcement Learning-Based Intelligent Control Strategies for Optimal Power Management in Advanced Power Distribution Systems: A Survey," Energies, MDPI, vol. 16(4), pages 1-38, February.
    13. Martina Arosio & Davide Falabretti, 2023. "DER Participation in Ancillary Services Market: An Analysis of Current Trends and Future Opportunities," Energies, MDPI, vol. 16(5), pages 1-21, March.
    14. Yuhang Zhang & Ming Ni, 2023. "Fully Distributed Optimal Economic Dispatch for Microgrids under Directed Communication Networks Considering Time Delays," Energies, MDPI, vol. 16(23), pages 1-22, December.
    15. Lu, Nianci & Pan, Lei & Pedersen, Simon & Arabkoohsar, Ahmad, 2023. "A two-dimensional design and synthesis method for coordinated control of flexible-operational combined cycle of gas turbine," Energy, Elsevier, vol. 284(C).
    16. Jiawei Wang & Aidong Zeng & Yaheng Wan, 2023. "Multi-Time-Scale Optimal Scheduling of Integrated Energy System Considering Transmission Delay and Heat Storage of Heating Network," Sustainability, MDPI, vol. 15(19), pages 1-26, September.
    17. Badesa, L. & Teng, F. & Strbac, G., 2020. "Pricing inertia and Frequency Response with diverse dynamics in a Mixed-Integer Second-Order Cone Programming formulation," Applied Energy, Elsevier, vol. 260(C).
    18. Caixin Yan & Zhifeng Qiu, 2025. "Review of Power Market Optimization Strategies Based on Industrial Load Flexibility," Energies, MDPI, vol. 18(7), pages 1-41, March.
    19. Antoine Boche & Clément Foucher & Luiz Fernando Lavado Villa, 2022. "Understanding Microgrid Sustainability: A Systemic and Comprehensive Review," Energies, MDPI, vol. 15(8), pages 1-29, April.
    20. Li-Peng Shao & Jia-Jia Chen & Lu-Wen Pan & Zi-Juan Yang, 2022. "A Credibility Theory-Based Robust Optimization Model to Hedge Price Uncertainty of DSO with Multiple Transactions," Mathematics, MDPI, vol. 10(23), pages 1-20, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:377:y:2025:i:pb:s0306261924017343. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.