IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v313y2024ics0360544224034157.html

Deep reinforcement learning based resource allocation for electric vehicle charging stations with priority service

Author

Listed:
  • Colak, Aslinur
  • Fescioglu-Unver, Nilgun

Abstract

The demand for public fast charging stations is increasing with the number of electric vehicles on roads. The charging queues and waiting times get longer, especially during the winter season and on holidays. Priority based service at charging stations can provide shorter delay times to vehicles willing to pay more and lower charging prices for vehicles accepting to wait more. Existing studies use classical feedback control and simulation based control methods to maintain the ratio of high and low priority vehicles’ delay times at the station’s target level. Reinforcement learning has been used successfully for real time control in environments with uncertainties. This study proposes a deep Q-Learning based real time resource allocation model for priority service in fast charging stations (DRL-EXP). Results show that the deep learning approach enables DRL-EXP to provide a more stable and faster response than the existing models. DRL-EXP is also applicable to other priority based service systems that act under uncertainties and require real time control.

Suggested Citation

  • Colak, Aslinur & Fescioglu-Unver, Nilgun, 2024. "Deep reinforcement learning based resource allocation for electric vehicle charging stations with priority service," Energy, Elsevier, vol. 313(C).
  • Handle: RePEc:eee:energy:v:313:y:2024:i:c:s0360544224034157
    DOI: 10.1016/j.energy.2024.133637
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224034157
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.133637?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Shen, Zuo-Jun Max & Feng, Bo & Mao, Chao & Ran, Lun, 2019. "Optimization models for electric vehicle service operations: A literature review," Transportation Research Part B: Methodological, Elsevier, vol. 128(C), pages 462-477.
    2. Kakillioglu, Emre Anıl & Yıldız Aktaş, Melike & Fescioglu-Unver, Nilgun, 2022. "Self-controlling resource management model for electric vehicle fast charging stations with priority service," Energy, Elsevier, vol. 239(PC).
    3. Bryden, Thomas S. & Hilton, George & Cruden, Andrew & Holton, Tim, 2018. "Electric vehicle fast charging station usage and power requirements," Energy, Elsevier, vol. 152(C), pages 322-332.
    4. Featherman, Mauricio & Jia, Shizhen (Jasper) & Califf, Christopher B. & Hajli, Nick, 2021. "The impact of new technologies on consumers beliefs: Reducing the perceived risks of electric vehicle adoption," Technological Forecasting and Social Change, Elsevier, vol. 169(C).
    5. Meng, Weiqi & Song, Dongran & Huang, Liansheng & Chen, Xiaojiao & Yang, Jian & Dong, Mi & Talaat, M. & Elkholy, M.H., 2024. "Distributed energy management of electric vehicle charging stations based on hierarchical pricing mechanism and aggregate feasible regions," Energy, Elsevier, vol. 291(C).
    6. Paudel, Diwas & Das, Tapas K., 2023. "A deep reinforcement learning approach for power management of battery-assisted fast-charging EV hubs participating in day-ahead and real-time electricity markets," Energy, Elsevier, vol. 283(C).
    7. Zhang, Xu & Peng, Linyu & Cao, Yue & Liu, Shuohan & Zhou, Huan & Huang, Keli, 2020. "Towards holistic charging management for urban electric taxi via a hybrid deployment of battery charging and swap stations," Renewable Energy, Elsevier, vol. 155(C), pages 703-716.
    8. Cheng Wang & Zhou Gao & Peng Yang & Zhenpo Wang & Zhiheng Li, 2021. "Electric Vehicle Charging Facility Planning Based on Flow Demand—A Case Study," Sustainability, MDPI, vol. 13(9), pages 1-23, April.
    9. Poyrazoglu, Gokturk & Coban, Elvin, 2021. "A stochastic value estimation tool for electric vehicle charging points," Energy, Elsevier, vol. 227(C).
    10. Fescioglu-Unver, Nilgun & Yıldız Aktaş, Melike, 2023. "Electric vehicle charging service operations: A review of machine learning applications for infrastructure planning, control, pricing and routing," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    11. Guy Desaulniers & Fausto Errico & Stefan Irnich & Michael Schneider, 2016. "Exact Algorithms for Electric Vehicle-Routing Problems with Time Windows," Operations Research, INFORMS, vol. 64(6), pages 1388-1405, December.
    12. Geng, Lijun & Lu, Zhigang & He, Liangce & Zhang, Jiangfeng & Li, Xueping & Guo, Xiaoqiang, 2019. "Smart charging management system for electric vehicles in coupled transportation and power distribution systems," Energy, Elsevier, vol. 189(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Meng, Yunfan & Sun, Yonghui & Xie, Dongliang & Xiao, Min & Yin, Chenxu & Zhao, Liang, 2025. "A two-stage optimization framework for EV charging station planning considering investment cost and service satisfaction," Applied Energy, Elsevier, vol. 402(PA).
    2. Çakıl, Fatih & Aksoy, Necati, 2025. "Reinforcement learning-based multi-objective smart energy management for electric vehicle charging stations with priority scheduling," Energy, Elsevier, vol. 322(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kakillioglu, Emre Anıl & Yıldız Aktaş, Melike & Fescioglu-Unver, Nilgun, 2022. "Self-controlling resource management model for electric vehicle fast charging stations with priority service," Energy, Elsevier, vol. 239(PC).
    2. Fescioglu-Unver, Nilgun & Yıldız Aktaş, Melike, 2023. "Electric vehicle charging service operations: A review of machine learning applications for infrastructure planning, control, pricing and routing," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    3. Tan, Zhijia & Wang, Ming & Zheng, Zhengfei & Yang, Hai, 2025. "Routing and adopting of green technology in road freight transportation under the carbon cap-and-trade scheme," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 203(C).
    4. Shubham Mishra & Shrey Verma & Subhankar Chowdhury & Ambar Gaur & Subhashree Mohapatra & Gaurav Dwivedi & Puneet Verma, 2021. "A Comprehensive Review on Developments in Electric Vehicle Charging Station Infrastructure and Present Scenario of India," Sustainability, MDPI, vol. 13(4), pages 1-20, February.
    5. Lai, Zhijie & Li, Sen, 2024. "Towards a multimodal charging network: Joint planning of charging stations and battery swapping stations for electrified ride-hailing fleets," Transportation Research Part B: Methodological, Elsevier, vol. 183(C).
    6. Zhan, Weipeng & Wang, Zhenpo & Zhang, Lei & Liu, Peng & Cui, Dingsong & Dorrell, David G., 2022. "A review of siting, sizing, optimal scheduling, and cost-benefit analysis for battery swapping stations," Energy, Elsevier, vol. 258(C).
    7. Wang, Song & Shi, Lefeng, 2024. "EV diffusion promotion analysis under different charging market structure," Technological Forecasting and Social Change, Elsevier, vol. 208(C).
    8. Chen, Runxin & Song, Dongran & Liao, Liqing & Yang, Jian & Dong, Mi & Talaat, M. & Elkholy, M.H., 2025. "Feedback correction scheduling strategy for electric vehicles based on multi-regional agent master-slave and evolutionary hybrid game," Energy, Elsevier, vol. 319(C).
    9. Osakwe, Christian Nedu & Ogunmokun, Oluwatobi A. & Elgammal, Islam & Kwarteng, Michael Adu, 2025. "Individuals' attitudes and their adoption intentions of central bank digital currency: Combining theories and analytics for deeper insights," Technological Forecasting and Social Change, Elsevier, vol. 210(C).
    10. Zhou, Yu & Meng, Qiang & Ong, Ghim Ping, 2022. "Electric Bus Charging Scheduling for a Single Public Transport Route Considering Nonlinear Charging Profile and Battery Degradation Effect," Transportation Research Part B: Methodological, Elsevier, vol. 159(C), pages 49-75.
    11. Baresch, Martin & Moser, Simon, 2019. "Allocation of e-car charging: Assessing the utilization of charging infrastructures by location," Transportation Research Part A: Policy and Practice, Elsevier, vol. 124(C), pages 388-395.
    12. Panagiotis Michailidis & Iakovos Michailidis & Elias Kosmatopoulos, 2025. "Reinforcement Learning for Electric Vehicle Charging Management: Theory and Applications," Energies, MDPI, vol. 18(19), pages 1-50, October.
    13. Shafqat Jawad & Junyong Liu, 2020. "Electrical Vehicle Charging Services Planning and Operation with Interdependent Power Networks and Transportation Networks: A Review of the Current Scenario and Future Trends," Energies, MDPI, vol. 13(13), pages 1-24, July.
    14. Wu, Weitiao & Lin, Yue & Liu, Ronghui & Jin, Wenzhou, 2022. "The multi-depot electric vehicle scheduling problem with power grid characteristics," Transportation Research Part B: Methodological, Elsevier, vol. 155(C), pages 322-347.
    15. Roel M. Post & Paul Buijs & Michiel A. J. uit het Broek & Jose A. Lopez Alvarez & Nick B. Szirbik & Iris F. A. Vis, 2018. "A solution approach for deriving alternative fuel station infrastructure requirements," Flexible Services and Manufacturing Journal, Springer, vol. 30(3), pages 592-607, September.
    16. Tingxin Wen & Haoting Meng, 2025. "Time-Dependent Multi-Center Semi-Open Heterogeneous Fleet Path Optimization and Charging Strategy," Mathematics, MDPI, vol. 13(7), pages 1-27, March.
    17. Gu, Bo & Li, Fangxing & Mao, Chengxiong & Wang, Dan & Fan, Hua & Liu, Bin & Li, Wenhao, 2025. "A Bilevel robust coordination model for community integrated energy system with access to HFCEVs and EVs," Applied Energy, Elsevier, vol. 390(C).
    18. Ann-Kathrin Rothenbächer & Michael Drexl & Stefan Irnich, 2018. "Branch-and-Price-and-Cut for the Truck-and-Trailer Routing Problem with Time Windows," Transportation Science, INFORMS, vol. 52(5), pages 1174-1190, October.
    19. Schulz, Arne & Boysen, Nils & Briskorn, Dirk, 2024. "Centrally-chosen versus user-selected swaps: How the selection of swapping stations impacts standby battery inventories," European Journal of Operational Research, Elsevier, vol. 319(3), pages 726-738.
    20. Ding, Yanyan & Jian, Sisi, 2024. "Strategic investment in charging infrastructure: Sharing costs or taking over?," Applied Energy, Elsevier, vol. 376(PA).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:313:y:2024:i:c:s0360544224034157. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.