IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i10p2513-d1654844.html
   My bibliography  Save this article

Future Smart Grids Control and Optimization: A Reinforcement Learning Tool for Optimal Operation Planning

Author

Listed:
  • Federico Rossi

    (Dipartimento di Elettronica Informazione e Bioingegneria, Politecnico di Milano, Piazza Leonardo da Vinci, 32, I-20133 Milano, Italy
    These authors contributed equally to this work.)

  • Giancarlo Storti Gajani

    (Dipartimento di Elettronica Informazione e Bioingegneria, Politecnico di Milano, Piazza Leonardo da Vinci, 32, I-20133 Milano, Italy
    These authors contributed equally to this work.)

  • Samuele Grillo

    (Dipartimento di Elettronica Informazione e Bioingegneria, Politecnico di Milano, Piazza Leonardo da Vinci, 32, I-20133 Milano, Italy
    These authors contributed equally to this work.)

  • Giambattista Gruosso

    (Dipartimento di Elettronica Informazione e Bioingegneria, Politecnico di Milano, Piazza Leonardo da Vinci, 32, I-20133 Milano, Italy
    These authors contributed equally to this work.)

Abstract

The smart grids of the future present innovative opportunities for data exchange and real-time operations management. In this context, it is crucial to integrate technological advancements with innovative planning algorithms, particularly those based on artificial intelligence (AI). AI methods offer powerful tools for planning electrical systems, including electrical distribution networks. This study presents a methodology based on reinforcement learning (RL) for evaluating optimal power flow with respect to various cost functions. Additionally, it addresses the control of dynamic constraints, such as voltage fluctuations at network nodes. A key insight is the use of historical real-world data to train the model, enabling its application in real-time scenarios. The algorithms were validated through simulations conducted on the IEEE 118-bus system, which included five case studies. Real datasets were used for both training and testing to enhance the algorithm’s practical relevance. The developed tool is versatile and applicable to power networks of varying sizes and load characteristics. Furthermore, the potential of RL for real-time applications was assessed, demonstrating its adaptability to online grid operations. This research represents a significant advancement in leveraging machine learning to improve the efficiency and stability of modern electrical grids.

Suggested Citation

  • Federico Rossi & Giancarlo Storti Gajani & Samuele Grillo & Giambattista Gruosso, 2025. "Future Smart Grids Control and Optimization: A Reinforcement Learning Tool for Optimal Operation Planning," Energies, MDPI, vol. 18(10), pages 1-19, May.
    • Handle: RePEc:gam:jeners:v:18:y:2025:i:10:p:2513-:d:1654844
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/10/2513/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/18/10/2513/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Mahmoud Kiasari & Mahdi Ghaffari & Hamed H. Aly, 2024. "A Comprehensive Review of the Current Status of Smart Grid Technologies for Renewable Energies Integration and Future Trends: The Role of Machine Learning and Energy Storage Systems," Energies, MDPI, vol. 17(16), pages 1-38, August.
    2. Benedetto-Giuseppe Risi & Francesco Riganti-Fulginei & Antonino Laudani, 2022. "Modern Techniques for the Optimal Power Flow Problem: State of the Art," Energies, MDPI, vol. 15(17), pages 1-20, September.
    3. Rocchetta, R. & Bellani, L. & Compare, M. & Zio, E. & Patelli, E., 2019. "A reinforcement learning framework for optimal operation and maintenance of power grids," Applied Energy, Elsevier, vol. 241(C), pages 291-301.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jose Antonio Carballo & Javier Bonilla & Jesús Fernández-Reche & Antonio Luis Avila-Marin & Blas Díaz, 2024. "Modern SCADA for CSP Systems Based on OPC UA, Wi-Fi Mesh Networks, and Open-Source Software," Energies, MDPI, vol. 17(24), pages 1-17, December.
    2. Nyong-Bassey, Bassey Etim & Giaouris, Damian & Patsios, Charalampos & Papadopoulou, Simira & Papadopoulos, Athanasios I. & Walker, Sara & Voutetakis, Spyros & Seferlis, Panos & Gadoue, Shady, 2020. "Reinforcement learning based adaptive power pinch analysis for energy management of stand-alone hybrid energy storage systems considering uncertainty," Energy, Elsevier, vol. 193(C).
    3. Huiling Li & Cong Liu & Qinjun Du & Qingtian Zeng & Jinglin Zhang & Georgios Theodoropoulo & Long Cheng, 2025. "Sampling-Based Next-Event Prediction for Wind-Turbine Maintenance Processes," Energies, MDPI, vol. 18(16), pages 1-17, August.
    4. Ning Wang & Weisheng Xu & Weihui Shao & Zhiyu Xu, 2019. "A Q-Cube Framework of Reinforcement Learning Algorithm for Continuous Double Auction among Microgrids," Energies, MDPI, vol. 12(15), pages 1-26, July.
    5. Correa-Jullian, Camila & López Droguett, Enrique & Cardemil, José Miguel, 2020. "Operation scheduling in a solar thermal system: A reinforcement learning-based framework," Applied Energy, Elsevier, vol. 268(C).
    6. Zhang, Dingyang & Zhang, Yiming & Li, Pei & Zhang, Shuyou, 2025. "Kernel Reinforcement Learning for sampling-efficient risk management of large-scale engineering systems," Reliability Engineering and System Safety, Elsevier, vol. 260(C).
    7. Shang, Yuwei & Wu, Wenchuan & Guo, Jianbo & Ma, Zhao & Sheng, Wanxing & Lv, Zhe & Fu, Chenran, 2020. "Stochastic dispatch of energy storage in microgrids: An augmented reinforcement learning approach," Applied Energy, Elsevier, vol. 261(C).
    8. Keerthana Sivamayil & Elakkiya Rajasekar & Belqasem Aljafari & Srete Nikolovski & Subramaniyaswamy Vairavasundaram & Indragandhi Vairavasundaram, 2023. "A Systematic Study on Reinforcement Learning Based Applications," Energies, MDPI, vol. 16(3), pages 1-23, February.
    9. Tai Zhang & Goran Strbac, 2025. "Artificial Intelligence Applications for Energy Storage: A Comprehensive Review," Energies, MDPI, vol. 18(17), pages 1-44, September.
    10. Mancuso, A. & Compare, M. & Salo, A. & Zio, E., 2021. "Optimal Prognostics and Health Management-driven inspection and maintenance strategies for industrial systems," Reliability Engineering and System Safety, Elsevier, vol. 210(C).
    11. Haltor Mataifa & Senthil Krishnamurthy & Carl Kriger, 2023. "Comparative Analysis of the Particle Swarm Optimization and Primal-Dual Interior-Point Algorithms for Transmission System Volt/VAR Optimization in Rectangular Voltage Coordinates," Mathematics, MDPI, vol. 11(19), pages 1-29, September.
    12. Joao C. Ferreira, 2025. "Bridging the Gaps: Future Directions for Blockchain and IoT Integration in Smart Grids," Energies, MDPI, vol. 18(4), pages 1-6, February.
    13. Stover, Oliver & Karve, Pranav & Mahadevan, Sankaran, 2023. "Reliability and risk metrics to assess operational adequacy and flexibility of power grids," Reliability Engineering and System Safety, Elsevier, vol. 231(C).
    14. Daeil Lee & Seoryong Koo & Inseok Jang & Jonghyun Kim, 2022. "Comparison of Deep Reinforcement Learning and PID Controllers for Automatic Cold Shutdown Operation," Energies, MDPI, vol. 15(8), pages 1-25, April.
    15. Pinciroli, Luca & Baraldi, Piero & Zio, Enrico, 2023. "Maintenance optimization in industry 4.0," Reliability Engineering and System Safety, Elsevier, vol. 234(C).
    16. Guan, Xiaoshu & Xiang, Zhengliang & Bao, Yuequan & Li, Hui, 2022. "Structural dominant failure modes searching method based on deep reinforcement learning," Reliability Engineering and System Safety, Elsevier, vol. 219(C).
    17. Compare, Michele & Antonello, Federico & Pinciroli, Luca & Zio, Enrico, 2022. "A general model for life-cycle cost analysis of Condition-Based Maintenance enabled by PHM capabilities," Reliability Engineering and System Safety, Elsevier, vol. 224(C).
    18. Zheng, Lingwei & Wu, Hao & Guo, Siqi & Sun, Xinyu, 2023. "Real-time dispatch of an integrated energy system based on multi-stage reinforcement learning with an improved action-choosing strategy," Energy, Elsevier, vol. 277(C).
    19. Theissler, Andreas & Pérez-Velázquez, Judith & Kettelgerdes, Marcel & Elger, Gordon, 2021. "Predictive maintenance enabled by machine learning: Use cases and challenges in the automotive industry," Reliability Engineering and System Safety, Elsevier, vol. 215(C).
    20. Hao, Zhaojun & Di Maio, Francesco & Zio, Enrico, 2023. "A sequential decision problem formulation and deep reinforcement learning solution of the optimization of O&M of cyber-physical energy systems (CPESs) for reliable and safe power production and supply," Reliability Engineering and System Safety, Elsevier, vol. 235(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:10:p:2513-:d:1654844. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.