IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i19p5225-d1762919.html

Reinforcement Learning for Electric Vehicle Charging Management: Theory and Applications

Author

Listed:
  • Panagiotis Michailidis

    (Center for Research and Technology Hellas, 57001 Thessaloniki, Greece
    Department of Electrical and Computer Engineering, Democritus University of Thrace, 67100 Xanthi, Greece)

  • Iakovos Michailidis

    (Center for Research and Technology Hellas, 57001 Thessaloniki, Greece
    Department of Electrical and Computer Engineering, Democritus University of Thrace, 67100 Xanthi, Greece)

  • Elias Kosmatopoulos

    (Center for Research and Technology Hellas, 57001 Thessaloniki, Greece
    Department of Electrical and Computer Engineering, Democritus University of Thrace, 67100 Xanthi, Greece)

Abstract

The growing complexity of electric vehicle charging station (EVCS) operations—driven by grid constraints, renewable integration, user variability, and dynamic pricing—has positioned reinforcement learning (RL) as a promising approach for intelligent, scalable, and adaptive control. After outlining the core theoretical foundations, including RL algorithms, agent architectures, and EVCS classifications, this review presents a structured survey of influential research, highlighting how RL has been applied across various charging contexts and control scenarios. This paper categorizes RL methodologies from value-based to actor–critic and hybrid frameworks, and explores their integration with optimization techniques, forecasting models, and multi-agent coordination strategies. By examining key design aspects—including agent structures, training schemes, coordination mechanisms, reward formulation, data usage, and evaluation protocols—this review identifies broader trends across central control dimensions such as scalability, uncertainty management, interpretability, and adaptability. In addition, the review assesses common baselines, performance metrics, and validation settings used in the literature, linking algorithmic developments with real-world deployment needs. By bridging theoretical principles with practical insights, this work provides comprehensive directions for future RL applications in EVCS control, while identifying methodological gaps and opportunities for safer, more efficient, and sustainable operation.

Suggested Citation

  • Panagiotis Michailidis & Iakovos Michailidis & Elias Kosmatopoulos, 2025. "Reinforcement Learning for Electric Vehicle Charging Management: Theory and Applications," Energies, MDPI, vol. 18(19), pages 1-50, October.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:19:p:5225-:d:1762919
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/19/5225/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/19/5225/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Minelli, Federico & Ciriello, Ilaria & Minichiello, Francesco & D'Agostino, Diana, 2024. "From Net Zero Energy Buildings to an energy sharing model - The role of NZEBs in Renewable Energy Communities," Renewable Energy, Elsevier, vol. 223(C).
    2. Zhang, Shulei & Jia, Runda & Pan, Hengxin & Cao, Yankai, 2023. "A safe reinforcement learning-based charging strategy for electric vehicles in residential microgrid," Applied Energy, Elsevier, vol. 348(C).
    3. Panagiotis Michailidis & Paschalis Pelitaris & Christos Korkas & Iakovos Michailidis & Simone Baldi & Elias Kosmatopoulos, 2021. "Enabling Optimal Energy Management with Minimal IoT Requirements: A Legacy A/C Case Study," Energies, MDPI, vol. 14(23), pages 1-25, November.
    4. Charalampos Rafail Lazaridis & Iakovos Michailidis & Georgios Karatzinis & Panagiotis Michailidis & Elias Kosmatopoulos, 2024. "Evaluating Reinforcement Learning Algorithms in Residential Energy Saving and Comfort Management," Energies, MDPI, vol. 17(3), pages 1-33, January.
    5. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    6. Panagiotis Michailidis & Iakovos Michailidis & Socratis Gkelios & Elias Kosmatopoulos, 2024. "Artificial Neural Network Applications for Energy Management in Buildings: Current Trends and Future Directions," Energies, MDPI, vol. 17(3), pages 1-47, January.
    7. Mehmet Kurucan & Panagiotis Michailidis & Iakovos Michailidis & Federico Minelli, 2025. "A Modular Hybrid SOC-Estimation Framework with a Supervisor for Battery Management Systems Supporting Renewable Energy Integration in Smart Buildings," Energies, MDPI, vol. 18(17), pages 1-30, August.
    8. Dorokhova, Marina & Martinson, Yann & Ballif, Christophe & Wyrsch, Nicolas, 2021. "Deep reinforcement learning control of electric vehicle charging in the presence of photovoltaic generation," Applied Energy, Elsevier, vol. 301(C).
    9. Cheng Wang & Zhou Gao & Peng Yang & Zhenpo Wang & Zhiheng Li, 2021. "Electric Vehicle Charging Facility Planning Based on Flow Demand—A Case Study," Sustainability, MDPI, vol. 13(9), pages 1-23, April.
    10. Jiang, C.X. & Jing, Z.X. & Cui, X.R. & Ji, T.Y. & Wu, Q.H., 2018. "Multiple agents and reinforcement learning for modelling charging loads of electric taxis," Applied Energy, Elsevier, vol. 222(C), pages 158-168.
    11. Tuchnitz, Felix & Ebell, Niklas & Schlund, Jonas & Pruckner, Marco, 2021. "Development and Evaluation of a Smart Charging Strategy for an Electric Vehicle Fleet Based on Reinforcement Learning," Applied Energy, Elsevier, vol. 285(C).
    12. Park, Keonwoo & Moon, Ilkyeong, 2022. "Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid," Applied Energy, Elsevier, vol. 328(C).
    13. Zhao, Zhonghao & Lee, Carman K.M. & Ren, Jingzheng, 2024. "A two-level charging scheduling method for public electric vehicle charging stations considering heterogeneous demand and nonlinear charging profile," Applied Energy, Elsevier, vol. 355(C).
    14. D'Agostino, D. & Minelli, F. & D'Urso, M. & Minichiello, F., 2022. "Fixed and tracking PV systems for Net Zero Energy Buildings: Comparison between yearly and monthly energy balance," Renewable Energy, Elsevier, vol. 195(C), pages 809-824.
    15. Lee, Sangyoon & Choi, Dae-Hyun, 2021. "Dynamic pricing and energy management for profit maximization in multiple smart electric vehicle charging stations: A privacy-preserving deep reinforcement learning approach," Applied Energy, Elsevier, vol. 304(C).
    16. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    17. Panagiotis Michailidis & Iakovos Michailidis & Elias Kosmatopoulos, 2025. "Reinforcement Learning for Optimizing Renewable Energy Utilization in Buildings: A Review on Applications and Innovations," Energies, MDPI, vol. 18(7), pages 1-40, March.
    18. Tao, Yuechuan & Qiu, Jing & Lai, Shuying & Sun, Xianzhuo & Zhao, Junhua & Zhou, Baorong & Cheng, Lanfen, 2022. "Data-driven on-demand energy supplement planning for electric vehicles considering multi-charging/swapping services," Applied Energy, Elsevier, vol. 311(C).
    19. Adetunji, Kayode E. & Hofsajer, Ivan W. & Abu-Mahfouz, Adnan M. & Cheng, Ling, 2022. "An optimization planning framework for allocating multiple distributed energy resources and electric vehicle charging stations in distribution networks," Applied Energy, Elsevier, vol. 322(C).
    20. Makeen, Peter & Ghali, Hani A. & Memon, Saim & Duan, Fang, 2023. "Smart techno-economic operation of electric vehicle charging station in Egypt," Energy, Elsevier, vol. 264(C).
    21. Gönül, Ömer & Duman, A. Can & Güler, Önder, 2024. "A comprehensive framework for electric vehicle charging station siting along highways using weighted sum method," Renewable and Sustainable Energy Reviews, Elsevier, vol. 199(C).
    22. Li, Yanbin & Wang, Jiani & Wang, Weiye & Liu, Chang & Li, Yun, 2023. "Dynamic pricing based electric vehicle charging station location strategy using reinforcement learning," Energy, Elsevier, vol. 281(C).
    23. Abid, Md. Shadman & Apon, Hasan Jamil & Hossain, Salman & Ahmed, Ashik & Ahshan, Razzaqul & Lipu, M.S. Hossain, 2024. "A novel multi-objective optimization based multi-agent deep reinforcement learning approach for microgrid resources planning," Applied Energy, Elsevier, vol. 353(PA).
    24. Xu, Hairun & Zhang, Ao & Wang, Qingle & Hu, Yang & Fang, Fang & Cheng, Long, 2025. "Quantum Reinforcement Learning for real-time optimization in Electric Vehicle charging systems," Applied Energy, Elsevier, vol. 383(C).
    25. Svetozarevic, B. & Baumann, C. & Muntwiler, S. & Di Natale, L. & Zeilinger, M.N. & Heer, P., 2022. "Data-driven control of room temperature and bidirectional EV charging using deep reinforcement learning: Simulations and experiments," Applied Energy, Elsevier, vol. 307(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qiu, Dawei & Wang, Yi & Hua, Weiqi & Strbac, Goran, 2023. "Reinforcement learning for electric vehicle applications in power systems:A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 173(C).
    2. Zhao, Zhonghao & Lee, Carman K.M. & Yan, Xiaoyuan & Wang, Haonan, 2024. "Reinforcement learning for electric vehicle charging scheduling: A systematic review," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 190(C).
    3. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    4. Homod, Raad Z. & Togun, Hussein & Kadhim Hussein, Ahmed & Noraldeen Al-Mousawi, Fadhel & Yaseen, Zaher Mundher & Al-Kouz, Wael & Abd, Haider J. & Alawi, Omer A. & Goodarzi, Marjan & Hussein, Omar A., 2022. "Dynamics analysis of a novel hybrid deep clustering for unsupervised learning by reinforcement of multi-agent to energy saving in intelligent buildings," Applied Energy, Elsevier, vol. 313(C).
    5. Abid, Md. Shadman & Apon, Hasan Jamil & Hossain, Salman & Ahmed, Ashik & Ahshan, Razzaqul & Lipu, M.S. Hossain, 2024. "A novel multi-objective optimization based multi-agent deep reinforcement learning approach for microgrid resources planning," Applied Energy, Elsevier, vol. 353(PA).
    6. Chen, Guibin & Yang, Lun & Cao, Xiaoyu, 2025. "A deep reinforcement learning-based charging scheduling approach with augmented Lagrangian for electric vehicles," Applied Energy, Elsevier, vol. 378(PA).
    7. Mahmud, Sakib & Sayed, Aya Nabil & Himeur, Yassine & Nhlabatsi, Armstrong & Bensaali, Faycal, 2026. "A comprehensive review of deep reinforcement learning applications from centralized power generation to modern energy internet frameworks," Renewable and Sustainable Energy Reviews, Elsevier, vol. 226(PE).
    8. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.
    9. Mansour, Shaza H. & Azzam, Sarah M. & Hasanien, Hany M. & Tostado-Véliz, Marcos & Alkuhayli, Abdulaziz & Jurado, Francisco, 2025. "Deep reinforcement learning-based plug-in electric vehicle charging/discharging scheduling in a home energy management system," Energy, Elsevier, vol. 316(C).
    10. Yang, Meng & Chen, Yue & Huang, Shihan & Chen, Laijun, 2025. "Recent advances in coordination and optimization of power-transportation systems: An overview," Renewable and Sustainable Energy Reviews, Elsevier, vol. 220(C).
    11. Golsefidi, Atefeh Hemmati & Hipolito, F. & Pereira, Francisco Câmara & Samaranayake, Samitha, 2025. "Incremental expansion of large scale fixed and mobile charging infrastructure in stochastic environments: A novel graph-based Benders decomposition approach," Applied Energy, Elsevier, vol. 380(C).
    12. Jin, Ruiyang & Zhou, Yuke & Lu, Chao & Song, Jie, 2022. "Deep reinforcement learning-based strategy for charging station participating in demand response," Applied Energy, Elsevier, vol. 328(C).
    13. Panagiotis Michailidis & Iakovos Michailidis & Dimitrios Vamvakas & Elias Kosmatopoulos, 2023. "Model-Free HVAC Control in Buildings: A Review," Energies, MDPI, vol. 16(20), pages 1-45, October.
    14. Zhou, Xizhen & Meng, Qiang & Ji, Yanjie, 2025. "Optimal charging schedules for EV charging stations considering hybrid smart and uncontrolled charging: A scalable framework," Applied Energy, Elsevier, vol. 398(C).
    15. An, Sihai & Qiu, Jing & Lin, Jiafeng & Yao, Zongyu & Liang, Qijun & Lu, Xin, 2025. "Planning of a multi-agent mobile robot-based adaptive charging network for enhancing power system resilience under extreme conditions," Applied Energy, Elsevier, vol. 395(C).
    16. Mokhtari, Reza & Montazeri, Mina & Cai, Hanmin & Heer, Philipp & Li, Rongling, 2025. "Price-responsive control using deep reinforcement learning for heating systems: Simulation and living lab experiment," Energy, Elsevier, vol. 337(C).
    17. Li, Yujing & Zhang, Zhisheng & Xing, Qiang, 2025. "Real-time online charging control of electric vehicle charging station based on a multi-agent deep reinforcement learning," Energy, Elsevier, vol. 319(C).
    18. Xu, Hairun & Zhang, Ao & Wang, Qingle & Hu, Yang & Fang, Fang & Cheng, Long, 2025. "Quantum Reinforcement Learning for real-time optimization in Electric Vehicle charging systems," Applied Energy, Elsevier, vol. 383(C).
    19. Li, Jing & Lin, Xueru & Huang, Hao & Wang, Rui & Zhong, Wei & Lin, Xiaojie & Wei, Wei, 2026. "Optimal operation of grid-friendly megawatt-level ultra-fast EV charging stations: A review on constraints, objectives and algorithms for grid-interactive operation," Applied Energy, Elsevier, vol. 405(C).
    20. Emily van Huffelen & Roel Brouwer & Marjan van den Akker, 2025. "Grid-Constrained Online Scheduling of Flexible Electric Vehicle Charging," Energies, MDPI, vol. 18(19), pages 1-20, September.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:19:p:5225-:d:1762919. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager The email address of this maintainer does not seem to be valid anymore. Please ask MDPI Indexing Manager to update the entry or send us the correct address (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.