IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v16y2024i22p10055-d1523619.html

Coordinated Ramp Metering Considering the Dynamics of Mixed-Autonomy Traffic

Author

Listed:
  • Hongxin Yu

    (College of Civil Engineering and Architecture, Balance Architecture Research Center, Zhejiang University, Hangzhou 310058, China)

  • Lihui Zhang

    (College of Civil Engineering and Architecture, Architectural Design and Research Institute, Zhejiang University, Hangzhou 310058, China)

  • Meng Zhang

    (College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

  • Fengyue Jin

    (College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

  • Yibing Wang

    (College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310058, China)

Abstract

The introduction of connected autonomous vehicles may bring opportunities and challenges to traditional traffic control instruments, like ramp metering. This paper starts by constructing the fundamental diagram for mixed-autonomy traffic based on the car-following behaviors of both connected autonomous vehicles and human-driven vehicles. Then, analyses are performed on the main factors that influence the critical velocity, critical density, and road capacity under mixed-autonomy traffic. Two methods named COE-HERO and TRLCRM are developed to support the implementations of coordinated ramp metering for freeways with mixed-autonomy traffic. The COE-HERO method enhances the HERO method by incorporating a critical occupancy estimation module. Both COE-HERO and TRLCRM consider dynamic traffic flow parameters of mixed-autonomy traffic. The TRLCRM method is a reinforcement learning-based approach with a two-stage training framework, enabling it to adapt to varying mixed-autonomy demand scenarios. Extensive microscopic simulations show that the learning-based TRLCRM method can effectively alleviate bottleneck congestion and is robust to deal with various traffic scenarios. The COE-HERO method performs better than the HERO method, indicating the necessity of critical occupancy estimation in the implementations of coordinated ramp metering.

Suggested Citation

  • Hongxin Yu & Lihui Zhang & Meng Zhang & Fengyue Jin & Yibing Wang, 2024. "Coordinated Ramp Metering Considering the Dynamics of Mixed-Autonomy Traffic," Sustainability, MDPI, vol. 16(22), pages 1-26, November.
  • Handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:10055-:d:1523619
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/16/22/10055/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2071-1050/16/22/10055/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Coifman, Benjamin, 2015. "Empirical flow-density and speed-spacing relationships: Evidence of vehicle length dependency," Transportation Research Part B: Methodological, Elsevier, vol. 78(C), pages 54-65.
    2. Sala, Marcel & Soriguera, Francesc, 2021. "Capacity of a freeway lane with platoons of autonomous vehicles mixed with regular traffic," Transportation Research Part B: Methodological, Elsevier, vol. 147(C), pages 116-131.
    3. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    4. Khan, Shah Khalid & Shiwakoti, Nirajan & Stasinopoulos, Peter & Warren, Matthew, 2023. "Cybersecurity regulatory challenges for connected and automated vehicles – State-of-the-art and future directions," Transport Policy, Elsevier, vol. 143(C), pages 58-71.
    5. Yu Lin & Hongfei Jia & Bo Zou & Hongzhi Miao & Ruiyi Wu & Jingjing Tian & Guanfeng Wang, 2021. "Multiobjective Environmentally Sustainable Optimal Design of Dedicated Connected Autonomous Vehicle Lanes," Sustainability, MDPI, vol. 13(6), pages 1-21, March.
    6. Salvatore Trubia & Salvatore Curto & Salvatore Barberi & Alessandro Severino & Fabio Arena & Giovanni Pau, 2021. "Analysis and Evaluation of Ramp Metering: From Historical Evolution to the Application of New Algorithms and Engineering Principles," Sustainability, MDPI, vol. 13(2), pages 1-19, January.
    7. Smaragdis, Emmanouil & Papageorgiou, Markos & Kosmatopoulos, Elias, 2004. "A flow-maximizing adaptive local ramp metering strategy," Transportation Research Part B: Methodological, Elsevier, vol. 38(3), pages 251-270, March.
    8. Ye, Lanhang & Yamamoto, Toshiyuki, 2018. "Modeling connected and autonomous vehicles in heterogeneous traffic flow," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 490(C), pages 269-277.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Guan, Hao & Wang, Hua & Meng, Qiang & Mak, Chin Long, 2023. "Markov chain-based traffic analysis on platooning effect among mixed semi- and fully-autonomous vehicles in a freeway lane," Transportation Research Part B: Methodological, Elsevier, vol. 173(C), pages 176-202.
    2. Zhao, Peilin & Wong, Yiik Diew & Zhu, Feng, 2025. "Modeling and analysis of the platoon size of Connected Autonomous Vehicles in a mixed traffic environment," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 199(C).
    3. Mohammed Al-Turki & Nedal T. Ratrout & Syed Masiur Rahman & Imran Reza, 2021. "Impacts of Autonomous Vehicles on Traffic Flow Characteristics under Mixed Traffic Environment: Future Perspectives," Sustainability, MDPI, vol. 13(19), pages 1-22, October.
    4. Pei, Yulong & Pan, Sheng & Wen, Yuhang, 2024. "Analysis of roadway capacity for heterogeneous traffic flows considering the degree of trust of drivers of HVs in CAVs," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 639(C).
    5. Li, Xin & Wang, Tianqi & Xu, Weihan & Li, Huaiyue & Yuan, Yun, 2024. "Modelling connected and autonomous bus on dynamics of mixed traffic in partially connected and automated traffic environment," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 191(C).
    6. Muhammad Azam & Sitti Asmah Hassan & Othman Che Puan, 2022. "Autonomous Vehicles in Mixed Traffic Conditions—A Bibliometric Analysis," Sustainability, MDPI, vol. 14(17), pages 1-34, August.
    7. Daniel Russo, 2023. "Approximation Benefits of Policy Gradient Methods with Aggregated States," Management Science, INFORMS, vol. 69(11), pages 6898-6911, November.
    8. Tulika Saha & Sriparna Saha & Pushpak Bhattacharyya, 2020. "Towards sentiment aided dialogue policy learning for multi-intent conversations using hierarchical reinforcement learning," PLOS ONE, Public Library of Science, vol. 15(7), pages 1-28, July.
    9. Shengnan Li & Hu Yang & Minglun Li & Jianjun Dai & Pu Wang, 2023. "A Highway On-Ramp Control Approach Integrating Percolation Bottleneck Analysis and Vehicle Source Identification," Sustainability, MDPI, vol. 15(16), pages 1-15, August.
    10. Mahmoud Mahfouz & Angelos Filos & Cyrine Chtourou & Joshua Lockhart & Samuel Assefa & Manuela Veloso & Danilo Mandic & Tucker Balch, 2019. "On the Importance of Opponent Modeling in Auction Markets," Papers 1911.12816, arXiv.org.
    11. Lixiang Zhang & Yan Yan & Yaoguang Hu, 2024. "Deep reinforcement learning for dynamic scheduling of energy-efficient automated guided vehicles," Journal of Intelligent Manufacturing, Springer, vol. 35(8), pages 3875-3888, December.
    12. Bai, Lu & Wong, S.C. & Xu, Pengpeng & Chow, Andy H.F. & Lam, William H.K., 2021. "Calibration of stochastic link-based fundamental diagram with explicit consideration of speed heterogeneity," Transportation Research Part B: Methodological, Elsevier, vol. 150(C), pages 524-539.
    13. Benjamin Heinbach & Peter Burggräf & Johannes Wagner, 2024. "gym-flp: A Python Package for Training Reinforcement Learning Algorithms on Facility Layout Problems," SN Operations Research Forum, Springer, vol. 5(1), pages 1-26, March.
    14. Konstantin Avrachenkov & Vivek S. Borkar & Pratik Shah, 2026. "Lagrangian index policy for restless bandits with average reward," Queueing Systems: Theory and Applications, Springer, vol. 110(1), pages 1-34, March.
    15. Woo Jae Byun & Bumkyu Choi & Seongmin Kim & Joohyun Jo, 2023. "Practical Application of Deep Reinforcement Learning to Optimal Trade Execution," FinTech, MDPI, vol. 2(3), pages 1-16, June.
    16. Lu, Yu & Xiang, Yue & Huang, Yuan & Yu, Bin & Weng, Liguo & Liu, Junyong, 2023. "Deep reinforcement learning based optimal scheduling of active distribution system considering distributed generation, energy storage and flexible load," Energy, Elsevier, vol. 271(C).
    17. Yuhong Wang & Lei Chen & Hong Zhou & Xu Zhou & Zongsheng Zheng & Qi Zeng & Li Jiang & Liang Lu, 2021. "Flexible Transmission Network Expansion Planning Based on DQN Algorithm," Energies, MDPI, vol. 14(7), pages 1-21, April.
    18. Pedro Reis & Ana Paula Serra & Jo~ao Gama, 2025. "The Role of Deep Learning in Financial Asset Management: A Systematic Review," Papers 2503.01591, arXiv.org.
    19. Qin, Yanyan & Liu, Changqing & Yan, Shiyi & Wang, Hua, 2025. "Management strategy for the maximum platoon size of connected automated vehicles in a freeway lane: A mixed traffic capacity modeling approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 201(C).
    20. Michelle M. LaMar, 2018. "Markov Decision Process Measurement Model," Psychometrika, Springer;The Psychometric Society, vol. 83(1), pages 67-88, March.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:16:y:2024:i:22:p:10055-:d:1523619. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.