IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v355y2024ics0306261923016422.html
   My bibliography  Save this article

A two-level charging scheduling method for public electric vehicle charging stations considering heterogeneous demand and nonlinear charging profile

Author

Listed:
  • Zhao, Zhonghao
  • Lee, Carman K.M.
  • Ren, Jingzheng

Abstract

This paper investigates the electric vehicle (EV) charging scheduling problem for public EV charging stations (EVCSs) that can accommodate heterogeneous charging demands, aiming to flatten the aggregate load on the power grid and reduce the peak demand. In contrast to existing works that mainly focus on a single scheduling strategy, a two-level hierarchical charging scheduling method is proposed, which includes an online booking system (OBS) and a pricing-based charging control system (PCCS). Specifically, the implementation of OBS can reduce the service capacity of bookable chargers, whereas PCCS can facilitate the redistribution of charging demand from peak to off-peak time periods. Moreover, the nonlinear charging profile of the battery is incorporated into the model to better reflect the real charging process. A deep reinforcement learning (DRL)-based approach with a discrete Markov decision process (MDP) formulation is designed to find the optimal scheduling solution, where deep Q-network (DQN) and deep deterministic policy gradient (DDPG) are combined to handle the hybrid action space with both discrete and continuous actions. A comprehensive set of experiments is carried out to examine the effectiveness of the developed two-level scheduling scheme. The results indicate that the proposed method improves the scheduling effectiveness compared to single-strategy methods by 6.7% to 49.44%.

Suggested Citation

  • Zhao, Zhonghao & Lee, Carman K.M. & Ren, Jingzheng, 2024. "A two-level charging scheduling method for public electric vehicle charging stations considering heterogeneous demand and nonlinear charging profile," Applied Energy, Elsevier, vol. 355(C).
    • Handle: RePEc:eee:appene:v:355:y:2024:i:c:s0306261923016422
    DOI: 10.1016/j.apenergy.2023.122278
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923016422
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.122278?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zhao, Zhonghao & Lee, Carman K.M. & Huo, Jiage, 2023. "EV charging station deployment on coupled transportation and power distribution networks via reinforcement learning," Energy, Elsevier, vol. 267(C).
    2. Liu, Lu & Zhou, Kaile, 2022. "Electric vehicle charging scheduling considering urgent demand under different charging modes," Energy, Elsevier, vol. 249(C).
    3. Li, Zhikang & Ma, Chengbin, 2022. "A temporal–spatial charging coordination scheme incorporating probability of EV charging availability," Applied Energy, Elsevier, vol. 325(C).
    4. Park, Keonwoo & Moon, Ilkyeong, 2022. "Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid," Applied Energy, Elsevier, vol. 328(C).
    5. Baumgarte, Felix & Kaiser, Matthias & Keller, Robert, 2021. "Policy support measures for widespread expansion of fast charging infrastructure for electric vehicles," Energy Policy, Elsevier, vol. 156(C).
    6. Su, Jun & Lie, T.T. & Zamora, Ramon, 2020. "A rolling horizon scheduling of aggregated electric vehicles charging under the electricity exchange market," Applied Energy, Elsevier, vol. 275(C).
    7. Rahman, Syed & Khan, Irfan Ahmed & Khan, Ashraf Ali & Mallik, Ayan & Nadeem, Muhammad Faisal, 2022. "Comprehensive review & impact analysis of integrating projected electric vehicle charging load to the existing low voltage distribution system," Renewable and Sustainable Energy Reviews, Elsevier, vol. 153(C).
    8. Zhou, Kaile & Cheng, Lexin & Wen, Lulu & Lu, Xinhui & Ding, Tao, 2020. "A coordinated charging scheduling method for electric vehicles considering different charging demands," Energy, Elsevier, vol. 213(C).
    9. Ahmadi Jirdehi, Mehdi & Sohrabi Tabar, Vahid, 2023. "Risk-aware energy management of a microgrid integrated with battery charging and swapping stations in the presence of renewable resources high penetration, crypto-currency miners and responsive loads," Energy, Elsevier, vol. 263(PA).
    10. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    11. Yin, Yilin & Choe, Song-Yul, 2020. "Actively temperature controlled health-aware fast charging method for lithium-ion battery using nonlinear model predictive control," Applied Energy, Elsevier, vol. 271(C).
    12. Zhang, Jin & Wang, Zhenpo & Liu, Peng & Zhang, Zhaosheng, 2020. "Energy consumption analysis and prediction of electric vehicles based on real-world driving data," Applied Energy, Elsevier, vol. 275(C).
    13. Kakillioglu, Emre Anıl & Yıldız Aktaş, Melike & Fescioglu-Unver, Nilgun, 2022. "Self-controlling resource management model for electric vehicle fast charging stations with priority service," Energy, Elsevier, vol. 239(PC).
    14. Tuchnitz, Felix & Ebell, Niklas & Schlund, Jonas & Pruckner, Marco, 2021. "Development and Evaluation of a Smart Charging Strategy for an Electric Vehicle Fleet Based on Reinforcement Learning," Applied Energy, Elsevier, vol. 285(C).
    15. Alqahtani, Mohammed & Hu, Mengqi, 2022. "Dynamic energy scheduling and routing of multiple electric vehicles using deep reinforcement learning," Energy, Elsevier, vol. 244(PA).
    16. Cedillo, Mónica Hernández & Sun, Hongjian & Jiang, Jing & Cao, Yue, 2022. "Dynamic pricing and control for EV charging stations with solar generation," Applied Energy, Elsevier, vol. 326(C).
    17. Xydas, Erotokritos & Marmaras, Charalampos & Cipcigan, Liana M., 2016. "A multi-agent based scheduling algorithm for adaptive electric vehicles charging," Applied Energy, Elsevier, vol. 177(C), pages 354-365.
    18. Montoya, Alejandro & Guéret, Christelle & Mendoza, Jorge E. & Villegas, Juan G., 2017. "The electric vehicle routing problem with nonlinear charging function," Transportation Research Part B: Methodological, Elsevier, vol. 103(C), pages 87-110.
    19. Kaile Zhou & Lulu Wen, 2022. "Electric Vehicle Charging Scheduling Considering Different Charging Demands," Springer Books, in: Smart Energy Management, chapter 0, pages 223-249, Springer.
    20. Das, H.S. & Rahman, M.M. & Li, S. & Tan, C.W., 2020. "Electric vehicles standards, charging infrastructure, and impact on grid integration: A technological review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 120(C).
    21. Khaki, Behnam & Chu, Chicheng & Gadh, Rajit, 2019. "Hierarchical distributed framework for EV charging scheduling using exchange problem," Applied Energy, Elsevier, vol. 241(C), pages 461-471.
    22. Powell, Siobhan & Kara, Emre Can & Sevlian, Raffi & Cezar, Gustavo Vianna & Kiliccote, Sila & Rajagopal, Ram, 2020. "Controlled workplace charging of electric vehicles: The impact of rate schedules on transformer aging," Applied Energy, Elsevier, vol. 276(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Maksymilian Mądziel, 2024. "Energy Modeling for Electric Vehicles Based on Real Driving Cycles: An Artificial Intelligence Approach for Microscale Analyses," Energies, MDPI, vol. 17(5), pages 1-22, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pegah Alaee & Julius Bems & Amjad Anvari-Moghaddam, 2023. "A Review of the Latest Trends in Technical and Economic Aspects of EV Charging Management," Energies, MDPI, vol. 16(9), pages 1-28, April.
    2. Park, Keonwoo & Moon, Ilkyeong, 2022. "Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid," Applied Energy, Elsevier, vol. 328(C).
    3. Fescioglu-Unver, Nilgun & Yıldız Aktaş, Melike, 2023. "Electric vehicle charging service operations: A review of machine learning applications for infrastructure planning, control, pricing and routing," Renewable and Sustainable Energy Reviews, Elsevier, vol. 188(C).
    4. Ming, Fangzhu & Gao, Feng & Liu, Kun & Li, Xingqi, 2023. "A constrained DRL-based bi-level coordinated method for large-scale EVs charging," Applied Energy, Elsevier, vol. 331(C).
    5. Paudel, Diwas & Das, Tapas K., 2023. "A deep reinforcement learning approach for power management of battery-assisted fast-charging EV hubs participating in day-ahead and real-time electricity markets," Energy, Elsevier, vol. 283(C).
    6. Liu, Lu & Zhou, Kaile, 2022. "Electric vehicle charging scheduling considering urgent demand under different charging modes," Energy, Elsevier, vol. 249(C).
    7. Li, Xiaohui & Wang, Zhenpo & Zhang, Lei & Sun, Fengchun & Cui, Dingsong & Hecht, Christopher & Figgener, Jan & Sauer, Dirk Uwe, 2023. "Electric vehicle behavior modeling and applications in vehicle-grid integration: An overview," Energy, Elsevier, vol. 268(C).
    8. Qiu, Dawei & Wang, Yi & Hua, Weiqi & Strbac, Goran, 2023. "Reinforcement learning for electric vehicle applications in power systems:A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 173(C).
    9. Kandpal, Bakul & Pareek, Parikshit & Verma, Ashu, 2022. "A robust day-ahead scheduling strategy for EV charging stations in unbalanced distribution grid," Energy, Elsevier, vol. 249(C).
    10. Zhao, Zhonghao & Lee, Carman K.M. & Huo, Jiage, 2023. "EV charging station deployment on coupled transportation and power distribution networks via reinforcement learning," Energy, Elsevier, vol. 267(C).
    11. Antonia Golab & Sebastian Zwickl-Bernhard & Hans Auer, 2022. "Minimum-Cost Fast-Charging Infrastructure Planning for Electric Vehicles along the Austrian High-Level Road Network," Energies, MDPI, vol. 15(6), pages 1-26, March.
    12. Ma, Shao-Chao & Yi, Bo-Wen & Fan, Ying, 2022. "Research on the valley-filling pricing for EV charging considering renewable power generation," Energy Economics, Elsevier, vol. 106(C).
    13. Einolander, Johannes & Lahdelma, Risto, 2022. "Multivariate copula procedure for electric vehicle charging event simulation," Energy, Elsevier, vol. 238(PA).
    14. Ahmed M. Abed & Ali AlArjani, 2022. "The Neural Network Classifier Works Efficiently on Searching in DQN Using the Autonomous Internet of Things Hybridized by the Metaheuristic Techniques to Reduce the EVs’ Service Scheduling Time," Energies, MDPI, vol. 15(19), pages 1-25, September.
    15. Alp, Osman & Tan, Tarkan & Udenio, Maximiliano, 2022. "Transitioning to sustainable freight transportation by integrating fleet replacement and charging infrastructure decisions," Omega, Elsevier, vol. 109(C).
    16. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    17. Hussain, Shahid & Irshad, Reyazur Rashid & Pallonetto, Fabiano & Hussain, Ihtisham & Hussain, Zakir & Tahir, Muhammad & Abimannan, Satheesh & Shukla, Saurabh & Yousif, Adil & Kim, Yun-Su & El-Sayed, H, 2023. "Hybrid coordination scheme based on fuzzy inference mechanism for residential charging of electric vehicles," Applied Energy, Elsevier, vol. 352(C).
    18. Jiankai Gao & Yang Li & Bin Wang & Haibo Wu, 2023. "Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm," Energies, MDPI, vol. 16(7), pages 1-21, April.
    19. Liu, Shuohan & Cao, Yue & Ni, Qiang & Xu, Lexi & Zhu, Yongdong & Zhang, Xin, 2023. "Towards reservation-based E-mobility service via hybrid of V2V and G2V charging modes," Energy, Elsevier, vol. 268(C).
    20. Dimitrios Vamvakas & Panagiotis Michailidis & Christos Korkas & Elias Kosmatopoulos, 2023. "Review and Evaluation of Reinforcement Learning Frameworks on Smart Grid Applications," Energies, MDPI, vol. 16(14), pages 1-38, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:355:y:2024:i:c:s0306261923016422. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.