IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v15y2022i22p8739-d978985.html
   My bibliography  Save this article

A Review on a Data-Driven Microgrid Management System Integrating an Active Distribution Network: Challenges, Issues, and New Trends

Author

Listed:
  • Lilia Tightiz

    (School of Computing, Gachon University, 1342 Seongnamdaero, Seongnam 13120, Republic of Korea)

  • Joon Yoo

    (School of Computing, Gachon University, 1342 Seongnamdaero, Seongnam 13120, Republic of Korea)

Abstract

The advent of renewable energy sources (RESs) in the power industry has revolutionized the management of these systems due to the necessity of controlling their stochastic nature. Deploying RESs in the microgrid (MG) as a subset of the utility grid is a beneficial way to achieve their countless merits in addition to controlling their random nature. Since a MG contains elements with different characteristics, its management requires multiple applications, such as demand response (DR), outage management, energy management, etc. The MG management can be optimized using machine learning (ML) techniques applied to the applications. This objective first calls for the microgrid management system (MGMS)’s required application recognition and then the optimization of interactions among the applications. Hence, this paper highlights significant research on applying ML techniques in the MGMS according to optimization function requirements. The relevant studies have been classified based on their objectives, methods, and implementation tools to find the best optimization and accurate methodologies. We mainly focus on the deep reinforcement learning (DRL) methods of ML since they satisfy the high-dimensional characteristics of MGs. Therefore, we investigated challenges and new trends in the utilization of DRL in a MGMS, especially as part of the active power distribution network (ADN).

Suggested Citation

  • Lilia Tightiz & Joon Yoo, 2022. "A Review on a Data-Driven Microgrid Management System Integrating an Active Distribution Network: Challenges, Issues, and New Trends," Energies, MDPI, vol. 15(22), pages 1-24, November.
  • Handle: RePEc:gam:jeners:v:15:y:2022:i:22:p:8739-:d:978985
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/15/22/8739/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/15/22/8739/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Carpenter, Bob & Gelman, Andrew & Hoffman, Matthew D. & Lee, Daniel & Goodrich, Ben & Betancourt, Michael & Brubaker, Marcus & Guo, Jiqiang & Li, Peter & Riddell, Allen, 2017. "Stan: A Probabilistic Programming Language," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 76(i01).
    2. Voyant, Cyril & Notton, Gilles & Kalogirou, Soteris & Nivet, Marie-Laure & Paoli, Christophe & Motte, Fabrice & Fouilloy, Alexis, 2017. "Machine learning methods for solar radiation forecasting: A review," Renewable Energy, Elsevier, vol. 105(C), pages 569-582.
    3. Hui, Hongxun & Ding, Yi & Shi, Qingxin & Li, Fangxing & Song, Yonghua & Yan, Jinyue, 2020. "5G network-based Internet of Things for demand response in smart grid: A survey on application potential," Applied Energy, Elsevier, vol. 257(C).
    4. Pallonetto, Fabiano & De Rosa, Mattia & Milano, Federico & Finn, Donal P., 2019. "Demand response algorithms for smart-grid ready residential buildings using machine learning models," Applied Energy, Elsevier, vol. 239(C), pages 1265-1282.
    5. Yagli, Gokhan Mert & Yang, Dazhi & Srinivasan, Dipti, 2019. "Automatic hourly solar forecasting using machine learning models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 105(C), pages 487-498.
    6. Sunyong Kim & Hyuk Lim, 2018. "Reinforcement Learning Based Energy Management Algorithm for Smart Energy Buildings," Energies, MDPI, vol. 11(8), pages 1-19, August.
    7. Muhammad Mateen Afzal Awan & Muhammad Yaqoob Javed & Aamer Bilal Asghar & Krzysztof Ejsmont & Zia-ur-Rehman, 2022. "Economic Integration of Renewable and Conventional Power Sources—A Case Study," Energies, MDPI, vol. 15(6), pages 1-20, March.
    8. Wang, Zhe & Hong, Tianzhen, 2020. "Reinforcement learning for building controls: The opportunities and challenges," Applied Energy, Elsevier, vol. 269(C).
    9. Rocchetta, R. & Bellani, L. & Compare, M. & Zio, E. & Patelli, E., 2019. "A reinforcement learning framework for optimal operation and maintenance of power grids," Applied Energy, Elsevier, vol. 241(C), pages 291-301.
    10. Jiangang Hao & Tin Kam Ho, 2019. "Machine Learning Made Easy: A Review of Scikit-learn Package in Python Programming Language," Journal of Educational and Behavioral Statistics, , vol. 44(3), pages 348-361, June.
    11. Lilia Tightiz & Hyosik Yang & Mohammad Jalil Piran, 2020. "A Survey on Enhanced Smart Micro-Grid Management System with Modern Wireless Technology Contribution," Energies, MDPI, vol. 13(9), pages 1-21, May.
    12. Babak Arbab-Zavar & Emilio J. Palacios-Garcia & Juan C. Vasquez & Josep M. Guerrero, 2019. "Smart Inverters for Microgrid Applications: A Review," Energies, MDPI, vol. 12(5), pages 1-22, March.
    13. Spodniak, Petr & Ollikka, Kimmo & Honkapuro, Samuli, 2021. "The impact of wind power and electricity demand on the relevance of different short-term electricity markets: The Nordic case," Applied Energy, Elsevier, vol. 283(C).
    14. Roslan, M.F. & Hannan, M.A. & Ker, Pin Jern & Uddin, M.N., 2019. "Microgrid control methods toward achieving sustainable energy management," Applied Energy, Elsevier, vol. 240(C), pages 583-607.
    15. Amir Mosavi & Mohsen Salimi & Sina Faizollahzadeh Ardabili & Timon Rabczuk & Shahaboddin Shamshirband & Annamaria R. Varkonyi-Koczy, 2019. "State of the Art of Machine Learning Models in Energy Systems, a Systematic Review," Energies, MDPI, vol. 12(7), pages 1-42, April.
    16. Brida V. Mbuwir & Frederik Ruelens & Fred Spiessens & Geert Deconinck, 2017. "Battery Energy Management in a Microgrid Using Batch Reinforcement Learning," Energies, MDPI, vol. 10(11), pages 1-19, November.
    17. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    18. Li, Qiang & Gao, Mengkai & Lin, Houfei & Chen, Ziyu & Chen, Minyou, 2019. "MAS-based distributed control method for multi-microgrids with high-penetration renewable energy," Energy, Elsevier, vol. 171(C), pages 284-295.
    19. Younes Zahraoui & Ibrahim Alhamrouni & Saad Mekhilef & M. Reyasudin Basir Khan & Mehdi Seyedmahmoudian & Alex Stojcevski & Ben Horan, 2021. "Energy Management System in Microgrids: A Comprehensive Review," Sustainability, MDPI, vol. 13(19), pages 1-33, September.
    20. Danny Espín-Sarzosa & Rodrigo Palma-Behnke & Oscar Núñez-Mata, 2020. "Energy Management Systems for Microgrids: Main Existing Trends in Centralized Control Architectures," Energies, MDPI, vol. 13(3), pages 1-32, January.
    21. Yang, Rui & Liu, Hui & Nikitas, Nikolaos & Duan, Zhu & Li, Yanfei & Li, Ye, 2022. "Short-term wind speed forecasting using deep reinforcement learning with improved multiple error correction approach," Energy, Elsevier, vol. 239(PB).
    22. Kuznetsova, Elizaveta & Li, Yan-Fu & Ruiz, Carlos & Zio, Enrico & Ault, Graham & Bell, Keith, 2013. "Reinforcement learning for microgrid energy management," Energy, Elsevier, vol. 59(C), pages 133-146.
    23. Gaurav Chaudhary & Jacob J. Lamb & Odne S. Burheim & Bjørn Austbø, 2021. "Review of Energy Storage and Energy Management System Control Strategies in Microgrids," Energies, MDPI, vol. 14(16), pages 1-26, August.
    24. Ying Ji & Jianhui Wang & Jiacan Xu & Xiaoke Fang & Huaguang Zhang, 2019. "Real-Time Energy Management of a Microgrid Using Deep Reinforcement Learning," Energies, MDPI, vol. 12(12), pages 1-21, June.
    25. Agüera-Pérez, Agustín & Palomares-Salas, José Carlos & González de la Rosa, Juan José & Florencias-Oliveros, Olivia, 2018. "Weather forecasts for microgrid energy management: Review, discussion and recommendations," Applied Energy, Elsevier, vol. 228(C), pages 265-278.
    26. Sadaqat Ali & Zhixue Zheng & Michel Aillerie & Jean-Paul Sawicki & Marie-Cécile Péra & Daniel Hissel, 2021. "A Review of DC Microgrid Energy Management Systems Dedicated to Residential Applications," Energies, MDPI, vol. 14(14), pages 1-26, July.
    27. Amrutha Raju Battula & Sandeep Vuddanti & Surender Reddy Salkuti, 2021. "Review of Energy Management System Approaches in Microgrids," Energies, MDPI, vol. 14(17), pages 1-32, September.
    28. Zia, Muhammad Fahad & Elbouchikhi, Elhoussin & Benbouzid, Mohamed, 2018. "Microgrids energy management systems: A critical review on methods, solutions, and prospects," Applied Energy, Elsevier, vol. 222(C), pages 1033-1055.
    29. Lilia Tightiz & Hyosik Yang, 2020. "A Comprehensive Review on IoT Protocols’ Features in Smart Grid Communication," Energies, MDPI, vol. 13(11), pages 1-24, June.
    30. Raya-Armenta, Jose Maurilio & Bazmohammadi, Najmeh & Avina-Cervantes, Juan Gabriel & Sáez, Doris & Vasquez, Juan C. & Guerrero, Josep M., 2021. "Energy management system optimization in islanded microgrids: An overview and future trends," Renewable and Sustainable Energy Reviews, Elsevier, vol. 149(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Guodong Liu & Maximiliano F. Ferrari & Thomas B. Ollis & Aditya Sundararajan & Mohammed Olama & Yang Chen, 2023. "Distributed Energy Management for Networked Microgrids with Hardware-in-the-Loop Validation," Energies, MDPI, vol. 16(7), pages 1-27, March.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ana Cabrera-Tobar & Alessandro Massi Pavan & Giovanni Petrone & Giovanni Spagnuolo, 2022. "A Review of the Optimization and Control Techniques in the Presence of Uncertainties for the Energy Management of Microgrids," Energies, MDPI, vol. 15(23), pages 1-38, December.
    2. Md Shafiullah & Akib Mostabe Refat & Md Ershadul Haque & Dewan Mabrur Hasan Chowdhury & Md Sanower Hossain & Abdullah G. Alharbi & Md Shafiul Alam & Amjad Ali & Shorab Hossain, 2022. "Review of Recent Developments in Microgrid Energy Management Strategies," Sustainability, MDPI, vol. 14(22), pages 1-30, November.
    3. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    4. Sharma, Pavitra & Dutt Mathur, Hitesh & Mishra, Puneet & Bansal, Ramesh C., 2022. "A critical and comparative review of energy management strategies for microgrids," Applied Energy, Elsevier, vol. 327(C).
    5. Grace Muriithi & Sunetra Chowdhury, 2021. "Optimal Energy Management of a Grid-Tied Solar PV-Battery Microgrid: A Reinforcement Learning Approach," Energies, MDPI, vol. 14(9), pages 1-24, May.
    6. Khawaja Haider Ali & Marvin Sigalo & Saptarshi Das & Enrico Anderlini & Asif Ali Tahir & Mohammad Abusara, 2021. "Reinforcement Learning for Energy-Storage Systems in Grid-Connected Microgrids: An Investigation of Online vs. Offline Implementation," Energies, MDPI, vol. 14(18), pages 1-18, September.
    7. Sabarathinam Srinivasan & Suresh Kumarasamy & Zacharias E. Andreadakis & Pedro G. Lind, 2023. "Artificial Intelligence and Mathematical Models of Power Grids Driven by Renewable Energy Sources: A Survey," Energies, MDPI, vol. 16(14), pages 1-56, July.
    8. Bio Gassi, Karim & Baysal, Mustafa, 2023. "Improving real-time energy decision-making model with an actor-critic agent in modern microgrids with energy storage devices," Energy, Elsevier, vol. 263(PE).
    9. Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).
    10. Juan D. Velásquez & Lorena Cadavid & Carlos J. Franco, 2023. "Intelligence Techniques in Sustainable Energy: Analysis of a Decade of Advances," Energies, MDPI, vol. 16(19), pages 1-45, October.
    11. Perera, A.T.D. & Kamalaruban, Parameswaran, 2021. "Applications of reinforcement learning in energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 137(C).
    12. Ritu Kandari & Neeraj Neeraj & Alexander Micallef, 2022. "Review on Recent Strategies for Integrating Energy Storage Systems in Microgrids," Energies, MDPI, vol. 16(1), pages 1-24, December.
    13. Van-Hai Bui & Akhtar Hussain & Hak-Man Kim, 2019. "Q-Learning-Based Operation Strategy for Community Battery Energy Storage System (CBESS) in Microgrid System," Energies, MDPI, vol. 12(9), pages 1-17, May.
    14. Tsianikas, Stamatis & Yousefi, Nooshin & Zhou, Jian & Rodgers, Mark D. & Coit, David, 2021. "A storage expansion planning framework using reinforcement learning and simulation-based optimization," Applied Energy, Elsevier, vol. 290(C).
    15. Fausto Calderon-Obaldia & Jordi Badosa & Anne Migan-Dubois & Vincent Bourdin, 2020. "A Two-Step Energy Management Method Guided by Day-Ahead Quantile Solar Forecasts: Cross-Impacts on Four Services for Smart-Buildings," Energies, MDPI, vol. 13(22), pages 1-29, November.
    16. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).
    17. Zhu, Ziqing & Hu, Ze & Chan, Ka Wing & Bu, Siqi & Zhou, Bin & Xia, Shiwei, 2023. "Reinforcement learning in deregulated energy market: A comprehensive review," Applied Energy, Elsevier, vol. 329(C).
    18. Shanmugarajah Vinothine & Lidula N. Widanagama Arachchige & Athula D. Rajapakse & Roshani Kaluthanthrige, 2022. "Microgrid Energy Management and Methods for Managing Forecast Uncertainties," Energies, MDPI, vol. 15(22), pages 1-22, November.
    19. Trinadh Pamulapati & Muhammed Cavus & Ishioma Odigwe & Adib Allahham & Sara Walker & Damian Giaouris, 2022. "A Review of Microgrid Energy Management Strategies from the Energy Trilemma Perspective," Energies, MDPI, vol. 16(1), pages 1-34, December.
    20. Svetozarevic, B. & Baumann, C. & Muntwiler, S. & Di Natale, L. & Zeilinger, M.N. & Heer, P., 2022. "Data-driven control of room temperature and bidirectional EV charging using deep reinforcement learning: Simulations and experiments," Applied Energy, Elsevier, vol. 307(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:22:p:8739-:d:978985. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.