IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i2p1329-d1031247.html
   My bibliography  Save this article

A Resilient Intelligent Traffic Signal Control Scheme for Accident Scenario at Intersections via Deep Reinforcement Learning

Author

Listed:
  • Zahra Zeinaly

    (Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran 14115-111, Iran)

  • Mahdi Sojoodi

    (Department of Electrical and Computer Engineering, Tarbiat Modares University, Tehran 14115-111, Iran)

  • Sadegh Bolouki

    (Department of Mechanical Engineering, Polytechnique Montréal, Montreal, QC H3T 1J4, Canada)

Abstract

Deep reinforcement learning methods have shown promising results in the development of adaptive traffic signal controllers. Accidents, weather conditions, or special events all have the potential to abruptly alter the traffic flow in real life. The traffic light must take immediate and appropriate action based on a reasonable understanding of the environment. In this way, traffic congestion would be prevented. In this paper, we develop a reliable controller for such a highly dynamic environment and investigate the resilience of these controllers to a variety of environmental disruptions, such as accidents. In this method, the agent is provided with a complete understanding of the environment by discretizing the intersection and modifying the state space. The proposed algorithm is independent of the location and time of accidents. If the location of the accident changes, the agent does not need to be retrained. The agent is trained using deep Q-learning and experience replay. The model is evaluated in the traffic microsimulator SUMO. The simulation results demonstrate that the proposed method is effective at shortening queues when there is disruption.

Suggested Citation

  • Zahra Zeinaly & Mahdi Sojoodi & Sadegh Bolouki, 2023. "A Resilient Intelligent Traffic Signal Control Scheme for Accident Scenario at Intersections via Deep Reinforcement Learning," Sustainability, MDPI, vol. 15(2), pages 1-26, January.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:2:p:1329-:d:1031247
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/2/1329/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/2/1329/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Dexin Yu & Xiujuan Tian & Xue Xing & Shutao Gao, 2016. "Signal Timing Optimization Based on Fuzzy Compromise Programming for Isolated Signalized Intersection," Mathematical Problems in Engineering, Hindawi, vol. 2016, pages 1-12, March.
    2. Hong Ki An & Muhammad Awais Javeed & Gimok Bae & Nimra Zubair & Ahmed Sayed M. Metwally & Patrizia Bocchetta & Fan Na & Muhammad Sufyan Javed, 2022. "Optimized Intersection Signal Timing: An Intelligent Approach-Based Study for Sustainable Models," Sustainability, MDPI, vol. 14(18), pages 1-19, September.
    3. Sadiqa Jafari & Zeinab Shahbazi & Yung-Cheol Byun, 2021. "Improving the Performance of Single-Intersection Urban Traffic Networks Based on a Model Predictive Controller," Sustainability, MDPI, vol. 13(10), pages 1-16, May.
    4. Yu, Chunhui & Ma, Wanjing & Han, Ke & Yang, Xiaoguang, 2017. "Optimization of vehicle and pedestrian signals at isolated intersections," Transportation Research Part B: Methodological, Elsevier, vol. 98(C), pages 135-153.
    5. Mohebifard, Rasool & Hajbabaie, Ali, 2019. "Optimal network-level traffic signal control: A benders decomposition-based solution algorithm," Transportation Research Part B: Methodological, Elsevier, vol. 121(C), pages 252-274.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Suhaib Alshayeb & Aleksandar Stevanovic & Nikola Mitrovic & Elio Espino, 2022. "Traffic Signal Optimization to Improve Sustainability: A Literature Review," Energies, MDPI, vol. 15(22), pages 1-24, November.
    2. Yu, Chunhui & Ma, Wanjing & Yang, Xiaoguang, 2020. "A time-slot based signal scheme model for fixed-time control at isolated intersections," Transportation Research Part B: Methodological, Elsevier, vol. 140(C), pages 176-192.
    3. Sara Sasaninejad & Joris Van Malderen & Joris Walraevens & Sabine Wittevrongel, 2023. "Expected Waiting Times at an Intersection with a Green Extension Strategy for Freight Vehicles: An Analytical Analysis," Mathematics, MDPI, vol. 11(3), pages 1-26, February.
    4. Riyadh Kamil Chillab & Aqeel S. Jaber & Mouna Ben Smida & Anis Sakly, 2023. "Optimal DG Location and Sizing to Minimize Losses and Improve Voltage Profile Using Garra Rufa Optimization," Sustainability, MDPI, vol. 15(2), pages 1-13, January.
    5. Sun, Qipeng & He, Chen & Wang, Yongjie & Liu, Hang & Ma, Fei & Wei, Xiao, 2022. "Reducing violation behaviors of pedestrians considering group interests of travelers at signalized crosswalk," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 594(C).
    6. Biao Yin & Monica Menendez & Kaidi Yang, 2021. "Joint Optimization of Intersection Control and Trajectory Planning Accounting for Pedestrians in a Connected and Automated Vehicle Environment," Sustainability, MDPI, vol. 13(3), pages 1-25, January.
    7. Keyan Bai & Enjian Yao & Long Pan & Linze Li & Wei Chen, 2020. "Dynamic Crosswalk Signal Timing Optimization Model Considering Vehicle and Pedestrian Delays and Fuel Consumption Cost," Sustainability, MDPI, vol. 12(2), pages 1-9, January.
    8. Serhii TURPAK & Vjacheslav TRUSHEVSKY & Olexiy KUZ’KIN & Sergey GRITCAY & Igor TARAN, 2021. "Improving The Efficiency Of Vehicle Operation And Its Environmental Friendliness Within The Controlled Crossings," Transport Problems, Silesian University of Technology, Faculty of Transport, vol. 16(3), pages 119-130, September.
    9. Hu, Yuting & Li, Shukai & Dessouky, Maged M. & Yang, Lixing & Gao, Ziyou, 2022. "Computationally efficient train timetable generation of metro networks with uncertain transfer walking time to reduce passenger waiting time: A generalized Benders decomposition-based method," Transportation Research Part B: Methodological, Elsevier, vol. 163(C), pages 210-231.
    10. Zhou, Xuesong, 2017. "Recasting and optimizing intersection automation as a connected-and-automated-vehicle (CAV) scheduling problem: A sequential branch-and-bound search approach in phase-time-traffic hypernetworkAuthor-N," Transportation Research Part B: Methodological, Elsevier, vol. 105(C), pages 479-506.
    11. Mohajerpoor, Reza & Saberi, Meead & Ramezani, Mohsen, 2019. "Analytical derivation of the optimal traffic signal timing: Minimizing delay variability and spillback probability for undersaturated intersections," Transportation Research Part B: Methodological, Elsevier, vol. 119(C), pages 45-68.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:2:p:1329-:d:1031247. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.