IDEAS home Printed from https://ideas.repec.org/a/kap/transp/v52y2025i2d10.1007_s11116-023-10433-w.html
   My bibliography  Save this article

Integrating reinforcement-learning-based vehicle dispatch algorithm into agent-based modeling of autonomous taxis

Author

Listed:
  • Zequn Li

    (Purdue University)

  • Mustafa Lokhandwala

    (Purdue University)

  • Abubakr O. Al-Abbasi

    (Purdue University)

  • Vaneet Aggarwal

    (Purdue University)

  • Hua Cai

    (Purdue University
    Purdue University)

Abstract

While increasing number of studies are using agent-based models to study the potential environmental, economic, and social impacts of shared autonomous vehicles, the idle vehicle dispatching in these models is often simplified to heuristic rules. Because the system performance of an autonomous taxi fleet can be significantly affected by the vehicle dispatching algorithm, refining the vehicle dispatching can help us better evaluate the potential benefits and impacts of shared autonomous vehicle systems. The recent development of reinforcement-learning-based vehicle dispatching algorithms provides opportunities to improve autonomous vehicle system modeling with efficient and scalable vehicle dispatching. This study integrates a reinforcement learning algorithm into to an agent-based simulation model of a ride hailing system. Using an autonomous taxi fleet in New York City as a case study, we compared the system performance of using the proposed Deep Q-Network (DQN) method for dispatching decision with common rule-based and heuristic dispatch algorithms from relevant literatures. The results show that (1) DQN dispatches vehicles more conservatively (with less dispatching activities and distances) but achieved similar (slightly lower) rider service level with proactive dispatch methods; and (2) DQN outperformed all other dispatch methods evaluated in this study with significantly higher dispatch efficiency, as measured by the ratio of the number of extra riders served due to dispatching to the extra fleet dispatch distance.

Suggested Citation

  • Zequn Li & Mustafa Lokhandwala & Abubakr O. Al-Abbasi & Vaneet Aggarwal & Hua Cai, 2025. "Integrating reinforcement-learning-based vehicle dispatch algorithm into agent-based modeling of autonomous taxis," Transportation, Springer, vol. 52(2), pages 641-667, April.
  • Handle: RePEc:kap:transp:v:52:y:2025:i:2:d:10.1007_s11116-023-10433-w
    DOI: 10.1007/s11116-023-10433-w
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11116-023-10433-w
    File Function: Abstract
    Download Restriction: Access to full text is restricted to subscribers.

    File URL: https://libkey.io/10.1007/s11116-023-10433-w?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Shen, Yu & Zhang, Hongmou & Zhao, Jinhua, 2018. "Integrating shared autonomous vehicle in public transportation system: A supply-side simulation of the first-mile service in Singapore," Transportation Research Part A: Policy and Practice, Elsevier, vol. 113(C), pages 125-136.
    2. Florian Dandl & Michael Hyland & Klaus Bogenberger & Hani S. Mahmassani, 2019. "Evaluating the impact of spatio-temporal demand forecast aggregation on the operational performance of shared autonomous mobility fleets," Transportation, Springer, vol. 46(6), pages 1975-1996, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Papaix, Claire & Eranova, Mariya & Zhou, Li, 2023. "Shared mobility research: Looking through a paradox lens," Transport Policy, Elsevier, vol. 133(C), pages 156-167.
    2. Alexandra König & Christina Wirth & Jan Grippenkoven, 2021. "Generation Y’s Information Needs Concerning Sharing Rides in Autonomous Mobility on Demand Systems," Sustainability, MDPI, vol. 13(14), pages 1-19, July.
    3. Jiangbo Yu & Graeme McKinley, 2024. "Synthetic Participatory Planning of Shared Automated Electric Mobility Systems," Sustainability, MDPI, vol. 16(13), pages 1-32, June.
    4. Zhang, Yufeng & Khani, Alireza, 2021. "Integrating transit systems with ride-sourcing services: A study on the system users’ stochastic equilibrium problem," Transportation Research Part A: Policy and Practice, Elsevier, vol. 150(C), pages 95-123.
    5. Manon Feys & Evy Rombaut & Lieselot Vanhaverbeke, 2020. "Experience and Acceptance of Autonomous Shuttles in the Brussels Capital Region," Sustainability, MDPI, vol. 12(20), pages 1-23, October.
    6. Wang, Senlei & Correia, Gonçalo Homem de Almeida & Lin, Hai Xiang, 2022. "Modeling the competition between multiple Automated Mobility on-Demand operators: An agent-based approach," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 605(C).
    7. Younghoon Seo & Donghyun Lim & Woongbee Son & Yeongmin Kwon & Junghwa Kim & Hyungjoo Kim, 2020. "Deriving Mobility Service Policy Issues Based on Text Mining: A Case Study of Gyeonggi Province in South Korea," Sustainability, MDPI, vol. 12(24), pages 1-20, December.
    8. Fehn, Fabian & Engelhardt, Roman & Dandl, Florian & Bogenberger, Klaus & Busch, Fritz, 2023. "Integrating parcel deliveries into a ride-pooling service—An agent-based simulation study," Transportation Research Part A: Policy and Practice, Elsevier, vol. 169(C).
    9. Hyland, Michael & Mahmassani, Hani S., 2020. "Operational benefits and challenges of shared-ride automated mobility-on-demand services," Transportation Research Part A: Policy and Practice, Elsevier, vol. 134(C), pages 251-270.
    10. Militão, Aitan M. & Tirachini, Alejandro, 2021. "Optimal fleet size for a shared demand-responsive transport system with human-driven vs automated vehicles: A total cost minimization approach," Transportation Research Part A: Policy and Practice, Elsevier, vol. 151(C), pages 52-80.
    11. Ziakopoulos, Apostolos & Oikonomou, Maria G. & Vlahogianni, Eleni I. & Yannis, George, 2021. "Quantifying the implementation impacts of a point to point automated urban shuttle service in a large-scale network," Transport Policy, Elsevier, vol. 114(C), pages 233-244.
    12. Weixi Ren & Bo Yu & Yuren Chen & Kun Gao, 2022. "Divergent Effects of Factors on Crash Severity under Autonomous and Conventional Driving Modes Using a Hierarchical Bayesian Approach," IJERPH, MDPI, vol. 19(18), pages 1-22, September.
    13. Ji, Yuxiong & Zhou, Minhang & Zheng, Yujing & Shen, Yu & Du, Yuchuan, 2024. "Urban passenger-and-package sharing transportation by e-hailing taxis: A simulation-based pricing analysis in shanghai," Transport Policy, Elsevier, vol. 156(C), pages 138-151.
    14. Neil Quarles & Kara M. Kockelman & Moataz Mohamed, 2020. "Costs and Benefits of Electrifying and Automating Bus Transit Fleets," Sustainability, MDPI, vol. 12(10), pages 1-15, May.
    15. Konstanze Winter & Oded Cats & Karel Martens & Bart Arem, 2021. "Relocating shared automated vehicles under parking constraints: assessing the impact of different strategies for on-street parking," Transportation, Springer, vol. 48(4), pages 1931-1965, August.
    16. Wen, Jian & Nassir, Neema & Zhao, Jinhua, 2019. "Value of demand information in autonomous mobility-on-demand systems," Transportation Research Part A: Policy and Practice, Elsevier, vol. 121(C), pages 346-359.
    17. He, Ping & Jin, Jian Gang & Trépanier, Martin & Schulte, Frederik, 2024. "A math-heuristic and exact algorithm for first-mile ridesharing problem with passenger service quality preferences," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 192(C).
    18. Sehyun Tak & Soomin Woo & Sungjin Park & Sunghoon Kim, 2021. "The City-Wide Impacts of the Interactions between Shared Autonomous Vehicle-Based Mobility Services and the Public Transportation System," Sustainability, MDPI, vol. 13(12), pages 1-29, June.
    19. Manivasakan, Hesavar & Kalra, Riddhi & O'Hern, Steve & Fang, Yihai & Xi, Yinfei & Zheng, Nan, 2021. "Infrastructure requirement for autonomous vehicle integration for future urban and suburban roads – Current practice and a case study of Melbourne, Australia," Transportation Research Part A: Policy and Practice, Elsevier, vol. 152(C), pages 36-53.
    20. Iva Bojic & Dániel Kondor & Wei Tu & Ke Mai & Paolo Santi & Carlo Ratti, 2021. "Identifying the Potential for Partial Integration of Private and Public Transportation," Sustainability, MDPI, vol. 13(6), pages 1-16, March.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:kap:transp:v:52:y:2025:i:2:d:10.1007_s11116-023-10433-w. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.