IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i16p7180-d1460861.html
   My bibliography  Save this article

Optimal Electric Vehicle Battery Management Using Q-learning for Sustainability

Author

Listed:
  • Pannee Suanpang

    (Department of Information Technology, Faculty of Science & Technology, Suan Dusit University, Bangkok 10300, Thailand)

  • Pitchaya Jamjuntr

    (Department of Electronic and Telecommunication, Faculty of Engineering, King Mongkut’s University of Technology Thonburi, Bangkok 10140, Thailand)

Abstract

This paper presents a comprehensive study on the optimization of electric vehicle (EV) battery management using Q-learning, a powerful reinforcement learning technique. As the demand for electric vehicles continues to grow, there is an increasing need for efficient battery-management strategies to extend battery life, enhance performance, and minimize operating costs. The primary objective of this research is to develop and assess a Q-learning-based approach to address the intricate challenges associated with EV battery management. This paper starts by elucidating the key challenges inherent in EV battery management and discusses the potential advantages of incorporating Q-learning into the optimization process. Leveraging Q-learning’s capacity to make dynamic decisions based on past experiences, we introduce a framework that considers state-of-charge, state-of-health, charging infrastructure, and driving patterns as critical state variables. The methodology is detailed, encompassing the selection of state, action, reward, and policy, with the training process informed by real-world data. Our experimental results underscore the efficacy of the Q-learning approach in optimizing battery management. Through the utilization of Q-learning, we achieve substantial enhancements in battery performance, energy efficiency, and overall EV sustainability. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach. A comparative analysis with traditional battery-management strategies is presented to highlight the superior performance of our approach, demonstrating compelling results. Our Q-learning-based method achieves a significant 15% improvement in energy efficiency compared to conventional methods, translating into substantial savings in operational costs and reduced environmental impact. Moreover, we observe a remarkable 20% increase in battery lifespan, showcasing the effectiveness of our approach in enhancing long-term sustainability and user satisfaction. This paper significantly enriches the body of knowledge on EV battery management by introducing an innovative, data-driven approach. It provides a comprehensive comparative analysis and applies novel methodologies for practical implementation. The implications of this research extend beyond the academic sphere to practical applications, fostering the broader adoption of electric vehicles and contributing to a reduction in environmental impact while enhancing user satisfaction.

Suggested Citation

  • Pannee Suanpang & Pitchaya Jamjuntr, 2024. "Optimal Electric Vehicle Battery Management Using Q-learning for Sustainability," Sustainability, MDPI, vol. 16(16), pages 1-50, August.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:16:p:7180-:d:1460861
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/16/7180/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/16/7180/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ioannis Vardopoulos & Maria Papoui-Evangelou & Bogdana Nosova & Luca Salvati, 2023. "Smart ‘Tourist Cities’ Revisited: Culture-Led Urban Sustainability and the Global Real Estate Market," Sustainability, MDPI, vol. 15(5), pages 1-26, February.
    2. Dokrak Insan & Wattanapong Rakwichian & Parichart Rachapradit & Prapita Thanarak, 2022. "The Business Analysis of Electric Vehicle Charging Stations to Power Environmentally Friendly Tourism: A Case Study of the Khao Kho Route in Thailand," International Journal of Energy Economics and Policy, Econjournals, vol. 12(6), pages 102-111, November.
    3. Oussama Ouramdane & Elhoussin Elbouchikhi & Yassine Amirat & Franck Le Gall & Ehsan Sedgh Gooya, 2022. "Home Energy Management Considering Renewable Resources, Energy Storage, and an Electric Vehicle as a Backup," Energies, MDPI, vol. 15(8), pages 1-20, April.
    4. Kantapich Preedakorn & David Butler & Jörn Mehnen, 2023. "Challenges for the Adoption of Electric Vehicles in Thailand: Potential Impacts, Barriers, and Public Policy Recommendations," Sustainability, MDPI, vol. 15(12), pages 1-21, June.
    5. Choon Kit Chan & Chi Hong Chung & Jeyagopi Raman, 2023. "Optimizing Thermal Management System in Electric Vehicle Battery Packs for Sustainable Transportation," Sustainability, MDPI, vol. 15(15), pages 1-14, August.
    6. Al-Alawi, Baha M. & Bradley, Thomas H., 2013. "Total cost of ownership, payback, and consumer preference modeling of plug-in hybrid electric vehicles," Applied Energy, Elsevier, vol. 103(C), pages 488-506.
    7. Carlo Corinaldesi & Georg Lettner & Daniel Schwabeneder & Amela Ajanovic & Hans Auer, 2020. "Impact of Different Charging Strategies for Electric Vehicles in an Austrian Office Site," Energies, MDPI, vol. 13(22), pages 1-17, November.
    8. Chang Liu & Chuanchen Bi, 2022. "Current Situation and Trend of Electric Vehicle Battery Business - Take CATL as an example," Technium Social Sciences Journal, Technium Science, vol. 38(1), pages 324-336, December.
    9. Konstantina Dimitriadou & Nick Rigogiannis & Symeon Fountoukidis & Faidra Kotarela & Anastasios Kyritsis & Nick Papanikolaou, 2023. "Current Trends in Electric Vehicle Charging Infrastructure; Opportunities and Challenges in Wireless Charging Integration," Energies, MDPI, vol. 16(4), pages 1-28, February.
    10. Ruoran Xu, 2023. "Framework for Building Smart Tourism Big Data Mining Model for Sustainable Development," Sustainability, MDPI, vol. 15(6), pages 1-16, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Anjie Lu & Jianguo Zhou & Minglei Qin & Danchen Liu, 2024. "Considering Carbon–Hydrogen Coupled Integrated Energy Systems: A Pathway to Sustainable Energy Transition in China Under Uncertainty," Sustainability, MDPI, vol. 16(21), pages 1-32, October.
    2. Andrea Ria & Pierpaolo Dini, 2024. "A Compact Overview on Li-Ion Batteries Characteristics and Battery Management Systems Integration for Automotive Applications," Energies, MDPI, vol. 17(23), pages 1-28, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hutchinson, Tim & Burgess, Stuart & Herrmann, Guido, 2014. "Current hybrid-electric powertrain architectures: Applying empirical design data to life cycle assessment and whole-life cost analysis," Applied Energy, Elsevier, vol. 119(C), pages 314-329.
    2. Li, Ke & Chen, Jixin & Sun, Xiaodong & Lei, Gang & Cai, Yingfeng & Chen, Long, 2023. "Application of wireless energy transmission technology in electric vehicles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 184(C).
    3. Alya AlHammadi & Nasser Al-Saif & Ameena Saad Al-Sumaiti & Mousa Marzband & Tareefa Alsumaiti & Ehsan Heydarian-Forushani, 2022. "Techno-Economic Analysis of Hybrid Renewable Energy Systems Designed for Electric Vehicle Charging: A Case Study from the United Arab Emirates," Energies, MDPI, vol. 15(18), pages 1-20, September.
    4. Christian Montaleza & Paul Arévalo & Jimmy Gallegos & Francisco Jurado, 2024. "Enhancing Energy Management Strategies for Extended-Range Electric Vehicles through Deep Q-Learning and Continuous State Representation," Energies, MDPI, vol. 17(2), pages 1-21, January.
    5. Ibrahim Mutambik, 2024. "Culturally Informed Technology: Assessing Its Importance in the Transition to Smart Sustainable Cities," Sustainability, MDPI, vol. 16(10), pages 1-20, May.
    6. Ioannis Vardopoulos & Sophia Ioannides & Marios Georgiou & Irene Voukkali & Luca Salvati & Yannis E. Doukas, 2023. "Shaping Sustainable Cities: A Long-Term GIS-Emanated Spatial Analysis of Settlement Growth and Planning in a Coastal Mediterranean European City," Sustainability, MDPI, vol. 15(14), pages 1-24, July.
    7. Makena Coffman & Paul Bernstein & Sherilyn Wee, 2017. "Electric vehicles revisited: a review of factors that affect adoption," Transport Reviews, Taylor & Francis Journals, vol. 37(1), pages 79-93, January.
    8. Jakov Topić & Jure Soldo & Filip Maletić & Branimir Škugor & Joško Deur, 2020. "Virtual Simulation of Electric Bus Fleets for City Bus Transport Electrification Planning," Energies, MDPI, vol. 13(13), pages 1-24, July.
    9. Wee, Sherilyn & Coffman, Makena & Allen, Scott, 2020. "EV driver characteristics: Evidence from Hawaii," Transport Policy, Elsevier, vol. 87(C), pages 33-40.
    10. Dumortier, Jerome & Siddiki, Saba & Carley, Sanya & Cisney, Joshua & Krause, Rachel & Lane, Bradley & Rupp, John & Graham, John, 2015. "Effects of Life Cycle Cost Information Disclosure on the Purchase Decision of Hybrid and Plug-In Vehicles," IU SPEA AgEcon Papers 198643, Indiana University, IU School of Public and Environmental Affairs.
    11. Dumortier, Jerome & Kent, Matthew W. & Payton, Seth B., 2016. "Plug-in vehicles and the future of road infrastructure funding in the United States," Energy Policy, Elsevier, vol. 95(C), pages 187-195.
    12. Hengyu Liu & Zuoxia Xing & Qingqi Zhao & Yang Liu & Pengfei Zhang, 2024. "An Orderly Charging and Discharging Strategy of Electric Vehicles Based on Space–Time Distributed Load Forecasting," Energies, MDPI, vol. 17(17), pages 1-17, August.
    13. Hewu Wang & Xiaobin Zhang & Lvwei Wu & Cong Hou & Huiming Gong & Qian Zhang & Minggao Ouyang, 2015. "Beijing passenger car travel survey: implications for alternative fuel vehicle deployment," Mitigation and Adaptation Strategies for Global Change, Springer, vol. 20(5), pages 817-835, June.
    14. Coffman, Makena & Bernstein, Paul & Wee, Sherilyn, 2017. "Integrating electric vehicles and residential solar PV," Transport Policy, Elsevier, vol. 53(C), pages 30-38.
    15. Abdulgader Alsharif & Chee Wei Tan & Razman Ayop & Ahmed Al Smin & Abdussalam Ali Ahmed & Farag Hamed Kuwil & Mohamed Mohamed Khaleel, 2023. "Impact of Electric Vehicle on Residential Power Distribution Considering Energy Management Strategy and Stochastic Monte Carlo Algorithm," Energies, MDPI, vol. 16(3), pages 1-22, January.
    16. Ibrahim Alsaidan & Mohd Bilal & Muhannad Alaraj & Mohammad Rizwan & Fahad M. Almasoudi, 2023. "A Novel EA-Based Techno–Economic Analysis of Charging System for Electric Vehicles: A Case Study of Qassim Region, Saudi Arabia," Mathematics, MDPI, vol. 11(9), pages 1-31, April.
    17. Kantapich Preedakorn & David Butler & Jörn Mehnen, 2023. "Challenges for the Adoption of Electric Vehicles in Thailand: Potential Impacts, Barriers, and Public Policy Recommendations," Sustainability, MDPI, vol. 15(12), pages 1-21, June.
    18. Pantitcha Thanatrakolsri & Duanpen Sirithian, 2025. "Toward Low-Carbon Mobility: Greenhouse Gas Emissions and Reduction Opportunities in Thailand’s Road Transport Sector," Clean Technol., MDPI, vol. 7(3), pages 1-34, July.
    19. Makena Coffman & Scott Allen & Sherilyn Wee, 2018. "Who are Driving Electric Vehicles? An analysis of factors that affect EV adoption in Hawaii," Working Papers 2018-3, University of Hawaii Economic Research Organization, University of Hawaii at Manoa.
    20. Ji, Dandan & Gan, Hongcheng, 2022. "Effects of providing total cost of ownership information on below-40 young consumers’ intent to purchase an electric vehicle: A case study in China," Energy Policy, Elsevier, vol. 165(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:16:p:7180-:d:1460861. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.