IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i5p1779-d1343192.html

Sustainable Smart Cities through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous Vehicles

Author

Listed:
  • Ali Louati

    (Department of Information Systems, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj 11942, Saudi Arabia)

  • Hassen Louati

    (SMART Lab, Higher Institute of Management, University of Tunis, Tunis 2000, Tunisia)

  • Elham Kariri

    (Department of Information Systems, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al-Kharj 11942, Saudi Arabia)

  • Wafa Neifar

    (Arabic Natural Language Processing Research Group (ANLP-RG), MIRACL Laboratory, University of Sfax, Sfax 3018, Tunisia)

  • Mohamed K. Hassan

    (Faculty of Telecommunications Engineering, Future University, Khartoum 10553, Sudan)

  • Mutaz H. H. Khairi

    (Faculty of Engineering, Future University, Khartoum 10553, Sudan)

  • Mohammed A. Farahat

    (Computer Science Department, Higher Future Institute for Specialized Technological Studies, Cairo 11765, Egypt)

  • Heba M. El-Hoseny

    (Computer Science Department, Higher Future Institute for Specialized Technological Studies, Cairo 11765, Egypt)

Abstract

As urban centers evolve into smart cities, sustainable mobility emerges as a cornerstone for ensuring environmental integrity and enhancing quality of life. Autonomous vehicles (AVs) play a pivotal role in this transformation, with the potential to significantly improve efficiency and safety, and reduce environmental impacts. This study introduces a novel Multi-Agent Actor–Critic (MA2C) algorithm tailored for multi-AV lane-changing in mixed-traffic scenarios, a critical component of intelligent transportation systems in smart cities. By incorporating a local reward system that values efficiency, safety, and passenger comfort, and a parameter-sharing scheme that encourages inter-agent collaboration, our MA2C algorithm presents a comprehensive approach to urban traffic management. The MA2C algorithm leverages reinforcement learning to optimize lane-changing decisions, ensuring optimal traffic flow and enhancing both environmental sustainability and urban living standards. The actor–critic architecture is refined to minimize variances in urban traffic conditions, enhancing predictability and safety. The study extends to simulating realistic human-driven vehicle (HDV) behavior using the Intelligent Driver Model (IDM) and the model of Minimizing Overall Braking Induced by Lane changes (MOBIL), contributing to more accurate and effective traffic management strategies. Empirical results indicate that the MA2C algorithm outperforms existing state-of-the-art models in managing lane changes, passenger comfort, and inter-vehicle cooperation, essential for the dynamic environment of smart cities. The success of the MA2C algorithm in facilitating seamless interaction between AVs and HDVs holds promise for more fluid urban traffic conditions, reduced congestion, and lower emissions. This research contributes to the growing body of knowledge on autonomous driving within the framework of sustainable smart cities, focusing on the integration of AVs into the urban fabric. It underscores the potential of machine learning and artificial intelligence in developing transportation systems that are not only efficient and safe but also sustainable, supporting the broader goals of creating resilient, adaptive, and environmentally friendly urban spaces.

Suggested Citation

  • Ali Louati & Hassen Louati & Elham Kariri & Wafa Neifar & Mohamed K. Hassan & Mutaz H. H. Khairi & Mohammed A. Farahat & Heba M. El-Hoseny, 2024. "Sustainable Smart Cities through Multi-Agent Reinforcement Learning-Based Cooperative Autonomous Vehicles," Sustainability, MDPI, vol. 16(5), pages 1-18, February.
    • Handle: RePEc:gam:jsusta:v:16:y:2024:i:5:p:1779-:d:1343192
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/5/1779/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/16/5/1779/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Shuo Feng & Haowei Sun & Xintao Yan & Haojie Zhu & Zhengxia Zou & Shengyin Shen & Henry X. Liu, 2023. "Dense reinforcement learning for safety validation of autonomous vehicles," Nature, Nature, vol. 615(7953), pages 620-627, March.
    2. Ali Louati & Elham Kariri, 2023. "Enhancing Intersection Performance for Tram and Connected Vehicles through a Collaborative Optimization," Sustainability, MDPI, vol. 15(12), pages 1-17, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen Qian & Jingbin Xu & Xin Xing & Feng Guo, 2026. "Test case sampling optimization for safety validation of automated driving systems," Nature Communications, Nature, vol. 17(1), pages 1-13, December.
    2. Ting Mei & Hui Liu & Bingrui Tong & Chaozhen Tong & Junjie Zhu & Yuxuan Wang & Mengyao Kou, 2025. "Exploring Knowledge Domain of Intelligent Safety and Security Studies by Bibliometric Analysis," Sustainability, MDPI, vol. 17(4), pages 1-26, February.
    3. Lan, Penghang & Chen, She & Li, Qihang & Li, Kelin & Wang, Feng & Zhao, Yaoxun, 2024. "Intelligent hydrogen-ammonia combined energy storage system with deep reinforcement learning," Renewable Energy, Elsevier, vol. 237(PB).
    4. Henry X. Liu & Shuo Feng, 2024. "Curse of rarity for autonomous vehicles," Nature Communications, Nature, vol. 15(1), pages 1-5, December.
    5. Ren, Qiaoqiao & Hu, Chengxuan & Xu, Min & Song, Jiatong, 2026. "Association rule mining of damage severities in autonomous vehicle rear-end crashes with supplementary built environment data," Reliability Engineering and System Safety, Elsevier, vol. 265(PA).
    6. Huaisheng Tu & Haotian Liu & Tuqiang Pan & Wuping Xie & Zihao Ma & Fan Zhang & Pengbai Xu & Leiming Wu & Ou Xu & Yi Xu & Yuwen Qin, 2025. "Deep empirical neural network for optical phase retrieval over a scattering medium," Nature Communications, Nature, vol. 16(1), pages 1-9, December.
    7. Sikai Chen & Shuya Zong & Tiantian Chen & Zilin Huang & Yanshen Chen & Samuel Labi, 2023. "A Taxonomy for Autonomous Vehicles Considering Ambient Road Infrastructure," Sustainability, MDPI, vol. 15(14), pages 1-27, July.
    8. Haicheng Liao & Zhenning Li & Guohui Zhang & Keqiang Li & Chengzhong Xu, 2025. "Toward Human-Like Trajectory Prediction for Autonomous Driving: A Behavior-Centric Approach," Transportation Science, INFORMS, vol. 59(4), pages 823-852, July.
    9. Ali Louati & Hassen Louati & Elham Kariri & Wafa Neifar & Mohammed A. Farahat & Heba M. El-Hoseny & Mohamed K. Hassan & Mutaz H. H. Khairi, 2024. "Sustainable Urban Mobility for Road Information Discovery-Based Cloud Collaboration and Gaussian Processes," Sustainability, MDPI, vol. 16(4), pages 1-16, February.
    10. Masoud Khanmohamadi & Marco Guerrieri, 2025. "Smart Intersections and Connected Autonomous Vehicles for Sustainable Smart Cities: A Brief Review," Sustainability, MDPI, vol. 17(7), pages 1-32, April.
    11. Bian, Jiang & Huang, Helai & Yu, Qianyuan & Zhou, Rui, 2025. "Search-to-Crash: Generating safety-critical scenarios from in-depth crash data for testing autonomous vehicles," Energy, Elsevier, vol. 332(C).
    12. Shuo Feng & Haojie Zhu & Haowei Sun & Xintao Yan & Linxuan He & Jingxuan Yang & Guangzhen Su & Boqi Li & Shu Li & Ling Wang & Shengyin Shen & Henry X. Liu, 2026. "Breaking through safety performance stagnation in autonomous vehicles with dense learning," Nature Communications, Nature, vol. 17(1), pages 1-13, December.
    13. Chen, Jiaxin & Tang, Xiaolin & Yang, Kai, 2024. "A unified benchmark for deep reinforcement learning-based energy management: Novel training ideas with the unweighted reward," Energy, Elsevier, vol. 307(C).
    14. Huang, Ruchen & He, Hongwen & Gao, Miaojue, 2023. "Training-efficient and cost-optimal energy management for fuel cell hybrid electric bus based on a novel distributed deep reinforcement learning framework," Applied Energy, Elsevier, vol. 346(C).
    15. Jinxiao Duan & Guanwen Zeng & Nimrod Serok & Daqing Li & Efrat Blumenfeld Lieberthal & Hai-Jun Huang & Shlomo Havlin, 2023. "Spatiotemporal dynamics of traffic bottlenecks yields an early signal of heavy congestions," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    16. Xu, Ningzhe & Liu, Jun & Fu, Xing & Shi, Yangming & Jones, Steven, 2025. "Understanding first responders’ familiarity and attitudes toward connected and automated vehicles (CAVs): insights from latent class analysis," Transportation Research Part A: Policy and Practice, Elsevier, vol. 202(C).
    17. Yong Wang & Jingda Wu & Hongwen He & Zhongbao Wei & Fengchun Sun, 2025. "Data-driven energy management for electric vehicles using offline reinforcement learning," Nature Communications, Nature, vol. 16(1), pages 1-16, December.
    18. Wenhui Zhang & Yajing Song & Ge Zhou & Ziwen Song & Cong Xi, 2023. "Multiobjective-Based Decision-Making for the Optimization of an Urban Passenger Traffic System Structure," Sustainability, MDPI, vol. 15(18), pages 1-20, September.
    19. Shi, Yunyang & Liu, Jinghan & Liu, Chengqi & Gu, Ziyuan, 2024. "DeepAD: An integrated decision-making framework for intelligent autonomous driving," Transportation Research Part A: Policy and Practice, Elsevier, vol. 183(C).
    20. Yao, Jiachi & Han, Te, 2026. "Utilizing large-scale foundation models for prognostics and health management in wind turbines: Techniques, challenges, and future directions," Renewable and Sustainable Energy Reviews, Elsevier, vol. 227(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:5:p:1779-:d:1343192. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.