IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v313y2024ics0360544224034157.html
   My bibliography  Save this article

Deep reinforcement learning based resource allocation for electric vehicle charging stations with priority service

Author

Listed:
  • Colak, Aslinur
  • Fescioglu-Unver, Nilgun

Abstract

The demand for public fast charging stations is increasing with the number of electric vehicles on roads. The charging queues and waiting times get longer, especially during the winter season and on holidays. Priority based service at charging stations can provide shorter delay times to vehicles willing to pay more and lower charging prices for vehicles accepting to wait more. Existing studies use classical feedback control and simulation based control methods to maintain the ratio of high and low priority vehicles’ delay times at the station’s target level. Reinforcement learning has been used successfully for real time control in environments with uncertainties. This study proposes a deep Q-Learning based real time resource allocation model for priority service in fast charging stations (DRL-EXP). Results show that the deep learning approach enables DRL-EXP to provide a more stable and faster response than the existing models. DRL-EXP is also applicable to other priority based service systems that act under uncertainties and require real time control.

Suggested Citation

  • Colak, Aslinur & Fescioglu-Unver, Nilgun, 2024. "Deep reinforcement learning based resource allocation for electric vehicle charging stations with priority service," Energy, Elsevier, vol. 313(C).
  • Handle: RePEc:eee:energy:v:313:y:2024:i:c:s0360544224034157
    DOI: 10.1016/j.energy.2024.133637
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224034157
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.133637?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shen, Zuo-Jun Max & Feng, Bo & Mao, Chao & Ran, Lun, 2019. "Optimization models for electric vehicle service operations: A literature review," Transportation Research Part B: Methodological, Elsevier, vol. 128(C), pages 462-477.
    2. Bryden, Thomas S. & Hilton, George & Cruden, Andrew & Holton, Tim, 2018. "Electric vehicle fast charging station usage and power requirements," Energy, Elsevier, vol. 152(C), pages 322-332.
    3. Featherman, Mauricio & Jia, Shizhen (Jasper) & Califf, Christopher B. & Hajli, Nick, 2021. "The impact of new technologies on consumers beliefs: Reducing the perceived risks of electric vehicle adoption," Technological Forecasting and Social Change, Elsevier, vol. 169(C).
    4. Paudel, Diwas & Das, Tapas K., 2023. "A deep reinforcement learning approach for power management of battery-assisted fast-charging EV hubs participating in day-ahead and real-time electricity markets," Energy, Elsevier, vol. 283(C).
    5. Fescioglu-Unver, Nilgun & Yıldız Aktaş, Melike, 2023. "Electric vehicle charging service operations: A review of machine learning applications for infrastructure planning, control, pricing and routing," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    6. Guy Desaulniers & Fausto Errico & Stefan Irnich & Michael Schneider, 2016. "Exact Algorithms for Electric Vehicle-Routing Problems with Time Windows," Operations Research, INFORMS, vol. 64(6), pages 1388-1405, December.
    7. Geng, Lijun & Lu, Zhigang & He, Liangce & Zhang, Jiangfeng & Li, Xueping & Guo, Xiaoqiang, 2019. "Smart charging management system for electric vehicles in coupled transportation and power distribution systems," Energy, Elsevier, vol. 189(C).
    8. Meng, Weiqi & Song, Dongran & Huang, Liansheng & Chen, Xiaojiao & Yang, Jian & Dong, Mi & Talaat, M. & Elkholy, M.H., 2024. "Distributed energy management of electric vehicle charging stations based on hierarchical pricing mechanism and aggregate feasible regions," Energy, Elsevier, vol. 291(C).
    9. Zhang, Xu & Peng, Linyu & Cao, Yue & Liu, Shuohan & Zhou, Huan & Huang, Keli, 2020. "Towards holistic charging management for urban electric taxi via a hybrid deployment of battery charging and swap stations," Renewable Energy, Elsevier, vol. 155(C), pages 703-716.
    10. Kakillioglu, Emre Anıl & Yıldız Aktaş, Melike & Fescioglu-Unver, Nilgun, 2022. "Self-controlling resource management model for electric vehicle fast charging stations with priority service," Energy, Elsevier, vol. 239(PC).
    11. Cheng Wang & Zhou Gao & Peng Yang & Zhenpo Wang & Zhiheng Li, 2021. "Electric Vehicle Charging Facility Planning Based on Flow Demand—A Case Study," Sustainability, MDPI, vol. 13(9), pages 1-23, April.
    12. Poyrazoglu, Gokturk & Coban, Elvin, 2021. "A stochastic value estimation tool for electric vehicle charging points," Energy, Elsevier, vol. 227(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kakillioglu, Emre Anıl & Yıldız Aktaş, Melike & Fescioglu-Unver, Nilgun, 2022. "Self-controlling resource management model for electric vehicle fast charging stations with priority service," Energy, Elsevier, vol. 239(PC).
    2. Fescioglu-Unver, Nilgun & Yıldız Aktaş, Melike, 2023. "Electric vehicle charging service operations: A review of machine learning applications for infrastructure planning, control, pricing and routing," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    3. Shubham Mishra & Shrey Verma & Subhankar Chowdhury & Ambar Gaur & Subhashree Mohapatra & Gaurav Dwivedi & Puneet Verma, 2021. "A Comprehensive Review on Developments in Electric Vehicle Charging Station Infrastructure and Present Scenario of India," Sustainability, MDPI, vol. 13(4), pages 1-20, February.
    4. Wang, Song & Shi, Lefeng, 2024. "EV diffusion promotion analysis under different charging market structure," Technological Forecasting and Social Change, Elsevier, vol. 208(C).
    5. Lai, Zhijie & Li, Sen, 2024. "Towards a multimodal charging network: Joint planning of charging stations and battery swapping stations for electrified ride-hailing fleets," Transportation Research Part B: Methodological, Elsevier, vol. 183(C).
    6. Zhan, Weipeng & Wang, Zhenpo & Zhang, Lei & Liu, Peng & Cui, Dingsong & Dorrell, David G., 2022. "A review of siting, sizing, optimal scheduling, and cost-benefit analysis for battery swapping stations," Energy, Elsevier, vol. 258(C).
    7. Baresch, Martin & Moser, Simon, 2019. "Allocation of e-car charging: Assessing the utilization of charging infrastructures by location," Transportation Research Part A: Policy and Practice, Elsevier, vol. 124(C), pages 388-395.
    8. Shafqat Jawad & Junyong Liu, 2020. "Electrical Vehicle Charging Services Planning and Operation with Interdependent Power Networks and Transportation Networks: A Review of the Current Scenario and Future Trends," Energies, MDPI, vol. 13(13), pages 1-24, July.
    9. Roel M. Post & Paul Buijs & Michiel A. J. uit het Broek & Jose A. Lopez Alvarez & Nick B. Szirbik & Iris F. A. Vis, 2018. "A solution approach for deriving alternative fuel station infrastructure requirements," Flexible Services and Manufacturing Journal, Springer, vol. 30(3), pages 592-607, September.
    10. Ann-Kathrin Rothenbächer & Michael Drexl & Stefan Irnich, 2018. "Branch-and-Price-and-Cut for the Truck-and-Trailer Routing Problem with Time Windows," Transportation Science, INFORMS, vol. 52(5), pages 1174-1190, October.
    11. Schulz, Arne & Boysen, Nils & Briskorn, Dirk, 2024. "Centrally-chosen versus user-selected swaps: How the selection of swapping stations impacts standby battery inventories," European Journal of Operational Research, Elsevier, vol. 319(3), pages 726-738.
    12. Ding, Yanyan & Jian, Sisi, 2024. "Strategic investment in charging infrastructure: Sharing costs or taking over?," Applied Energy, Elsevier, vol. 376(PA).
    13. Ouyang, Kechen & Wang, David Z.W., 2025. "Optimal operation strategies for freight transport with electric vehicles considering wireless charging lanes," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 193(C).
    14. Ana Bricia Galindo-Muro & Riccardo Cespi & Stephany Isabel Vallarta-Serrano, 2023. "Applications of Electric Vehicles in Instant Deliveries," Energies, MDPI, vol. 16(4), pages 1-18, February.
    15. Su, Yue & Dupin, Nicolas & Parragh, Sophie N. & Puchinger, Jakob, 2024. "A Branch-and-Price algorithm for the electric autonomous Dial-A-Ride Problem," Transportation Research Part B: Methodological, Elsevier, vol. 186(C).
    16. Timothy M. Sweda & Irina S. Dolinskaya & Diego Klabjan, 2017. "Adaptive Routing and Recharging Policies for Electric Vehicles," Transportation Science, INFORMS, vol. 51(4), pages 1326-1348, November.
    17. Yossi Hadad & Baruch Keren & Dima Alberg, 2023. "An Expert System for Ranking and Matching Electric Vehicles to Customer Specifications and Requirements," Energies, MDPI, vol. 16(11), pages 1-18, May.
    18. Raeesi, Ramin & Zografos, Konstantinos G., 2020. "The electric vehicle routing problem with time windows and synchronised mobile battery swapping," Transportation Research Part B: Methodological, Elsevier, vol. 140(C), pages 101-129.
    19. Cortés-Murcia, David L. & Prodhon, Caroline & Murat Afsar, H., 2019. "The electric vehicle routing problem with time windows, partial recharges and satellite customers," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 130(C), pages 184-206.
    20. Adil, Muhammad & Mahmud, M.A. Parvez & Kouzani, Abbas Z. & Khoo, Sui Yang, 2024. "Three-stage energy trading framework for retailers, charging stations, and electric vehicles: A game-theoretic approach," Energy, Elsevier, vol. 301(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:313:y:2024:i:c:s0360544224034157. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.