IDEAS home Printed from https://ideas.repec.org/a/eee/phsmap/v677y2025ics0378437125005564.html

Multi-scale trajectory reconstruction for freeway traffic via deep reinforcement learning under heterogeneous data

Author

Listed:
  • Gao, Yuhang
  • Zhao, Jiandong
  • Yu, Zhixin
  • Cao, Honglu
  • Liu, Meng

Abstract

Precise vehicle trajectory data is essential for traffic flow modeling, trajectory prediction, and energy consumption estimation. However, fixed detectors yield only sparse point-based observations, while mobile detectors such as probe vehicles (PVs) provide complete but low-frequency trajectories, making it difficult to directly capture full vehicle trajectories. To address this challenge, this study proposes a multi-scale trajectory reconstruction framework that focuses on lane-level spatiotemporal trajectories, leveraging macroscopic traffic states to guide the reconstruction of microscopic vehicle trajectories via deep reinforcement learning (DRL). First, an improved adaptive smoothing algorithm is developed to address data imbalance between fixed and mobile detectors, constructing a macroscopic velocity field that serves as both the decision environment and the reward reference for the DRL agent. Second, based on the two-dimensional intelligent driver model (2D-IDM) and its extended version, a set of bidirectional candidate trajectories incorporating driver stochasticity is generated by jointly considering the upstream and downstream PV behaviors, providing physically plausible microscopic priors. The DRL agent then learns an optimal trajectory fusion policy by minimizing the deviation between the fused velocity and the macroscopic field. The proposed framework is evaluated on NGSIM dataset under both free-flow and congested conditions. Experimental results show that the proposed method reduces speed errors by over 30.97 % and position errors by more than 20.12 % compared to baseline models, consistently achieving superior accuracy, stability, and generalization.

Suggested Citation

  • Gao, Yuhang & Zhao, Jiandong & Yu, Zhixin & Cao, Honglu & Liu, Meng, 2025. "Multi-scale trajectory reconstruction for freeway traffic via deep reinforcement learning under heterogeneous data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 677(C).
  • Handle: RePEc:eee:phsmap:v:677:y:2025:i:c:s0378437125005564
    DOI: 10.1016/j.physa.2025.130904
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0378437125005564
    Download Restriction: Full text for ScienceDirect subscribers only. Journal offers the option of making the article available online on Science direct for a fee of $3,000

    File URL: https://libkey.io/10.1016/j.physa.2025.130904?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Coifman, Benjamin, 2002. "Estimating travel times and vehicle trajectories on freeways using dual loop detectors," Transportation Research Part A: Policy and Practice, Elsevier, vol. 36(4), pages 351-364, May.
    2. Deng, Wen & Lei, Hao & Zhou, Xuesong, 2013. "Traffic state estimation and uncertainty quantification based on heterogeneous data sources: A three detector approach," Transportation Research Part B: Methodological, Elsevier, vol. 57(C), pages 132-157.
    3. Seo, Toru & Kawasaki, Yutaka & Kusakabe, Takahiko & Asakura, Yasuo, 2019. "Fundamental diagram estimation by using trajectories of probe vehicles," Transportation Research Part B: Methodological, Elsevier, vol. 122(C), pages 40-56.
    4. repec:plo:pone00:0094351 is not listed on IDEAS
    5. Wang, Yinpu & An, Chengchuan & Ou, Jishun & Lu, Zhenbo & Xia, Jingxin, 2022. "A general dynamic sequential learning framework for vehicle trajectory reconstruction using automatic vehicle location or identification data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 608(P1).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sun, Zhe & Jin, Wen-Long & Ritchie, Stephen G., 2017. "Simultaneous estimation of states and parameters in Newell’s simplified kinematic wave model with Eulerian and Lagrangian traffic data," Transportation Research Part B: Methodological, Elsevier, vol. 104(C), pages 106-122.
    2. Nantes, Alfredo & Ngoduy, Dong & Miska, Marc & Chung, Edward, 2015. "Probabilistic travel time progression and its application to automatic vehicle identification data," Transportation Research Part B: Methodological, Elsevier, vol. 81(P1), pages 131-145.
    3. Florin, Ryan & Olariu, Stephan, 2020. "Towards real-time density estimation using vehicle-to-vehicle communications," Transportation Research Part B: Methodological, Elsevier, vol. 138(C), pages 435-456.
    4. Dimitris Bertsimas & Arthur Delarue & Patrick Jaillet & Sébastien Martin, 2019. "Travel Time Estimation in the Age of Big Data," Operations Research, INFORMS, vol. 67(2), pages 498-515, March.
    5. Ma, Tao & Zhou, Zhou & Antoniou, Constantinos, 2018. "Dynamic factor model for network traffic state forecast," Transportation Research Part B: Methodological, Elsevier, vol. 118(C), pages 281-317.
    6. Treiber, Martin & Kesting, Arne & Helbing, Dirk, 2010. "Three-phase traffic theory and two-phase models with a fundamental diagram in the light of empirical stylized facts," Transportation Research Part B: Methodological, Elsevier, vol. 44(8-9), pages 983-1000, September.
    7. Weifeng Yin & Junyong Zhai & Yongbo Yu, 2025. "Reconstruction of Highway Vehicle Paths Using a Two-Stage Model," Mathematics, MDPI, vol. 13(4), pages 1-20, February.
    8. Chen, Chao, 2004. "Travel Times on Changeable Message Signs: Pilot Project," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt2wp2p0m6, Institute of Transportation Studies, UC Berkeley.
    9. Gao, Yang & Levinson, David, 2024. "A multi-stage spatial queueing model with logistic arrivals and departures consistent with the microscopic fundamental diagram and hysteresis," Transportation Research Part B: Methodological, Elsevier, vol. 186(C).
    10. Flötteröd, G. & Osorio, C., 2017. "Stochastic network link transmission model," Transportation Research Part B: Methodological, Elsevier, vol. 102(C), pages 180-209.
    11. Taylor, Jeffrey & Zhou, Xuesong & Rouphail, Nagui M. & Porter, Richard J., 2015. "Method for investigating intradriver heterogeneity using vehicle trajectory data: A Dynamic Time Warping approach," Transportation Research Part B: Methodological, Elsevier, vol. 73(C), pages 59-80.
    12. Canepa, Edward S. & Claudel, Christian G., 2017. "Networked traffic state estimation involving mixed fixed-mobile sensor data using Hamilton-Jacobi equations," Transportation Research Part B: Methodological, Elsevier, vol. 104(C), pages 686-709.
    13. Yin, Ruyang & Zheng, Nan & Liu, Zhiyuan, 2022. "Estimating fundamental diagram for multi-modal signalized urban links with limited probe data," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 606(C).
    14. Čičić, Mladen & Johansson, Karl Henrik, 2022. "Front-tracking transition system model for traffic state reconstruction, model learning, and control with application to stop-and-go wave dissipation," Transportation Research Part B: Methodological, Elsevier, vol. 166(C), pages 212-236.
    15. Deng, Wen & Lei, Hao & Zhou, Xuesong, 2013. "Traffic state estimation and uncertainty quantification based on heterogeneous data sources: A three detector approach," Transportation Research Part B: Methodological, Elsevier, vol. 57(C), pages 132-157.
    16. Jeffrey P. Kharoufeh & Natarajan Gautam, 2004. "Deriving Link Travel-Time Distributions via Stochastic Speed Processes," Transportation Science, INFORMS, vol. 38(1), pages 97-106, February.
    17. Coifman, Benjamin, 2006. "Extracting More Information from the Existing Freeway Traffic Monitoring Infrastructure," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt34n479gz, Institute of Transportation Studies, UC Berkeley.
    18. Sengupta, Raja & Misener, Jim & Ahern, Katherine & Chan, Ching-Yao & Gupta, Somak Datta & Jariyasunant, Jerry & Li, Jing-Quan & Long, Christopher & Mai, Eric & Manasseh, Christian & Nowakowski, Christ, 2010. "Safetrip-21: Connected Traveler," Institute of Transportation Studies, Research Reports, Working Papers, Proceedings qt195910n5, Institute of Transportation Studies, UC Berkeley.
    19. Shang, Wen-Long & Zhang, Mengxiao & Wu, Guoyuan & Yang, Lan & Fang, Shan & Ochieng, Washington, 2023. "Estimation of traffic energy consumption based on macro-micro modelling with sparse data from Connected and Automated Vehicles," Applied Energy, Elsevier, vol. 351(C).
    20. Varga, Balázs & Tettamanti, Tamás & Kulcsár, Balázs & Qu, Xiaobo, 2020. "Public transport trajectory planning with probabilistic guarantees," Transportation Research Part B: Methodological, Elsevier, vol. 139(C), pages 81-101.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:phsmap:v:677:y:2025:i:c:s0378437125005564. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/physica-a-statistical-mechpplications/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.