IDEAS home Printed from https://ideas.repec.org/a/eee/transe/v200y2025ics1366554525002327.html

An intelligent multi-agent system for last-mile logistics

Author

Listed:
  • Kahalimoghadam, Masoud
  • Thompson, Russell G.
  • Rajabifard, Abbas

Abstract

Operational efficiency in last-mile logistics (LML) is often hindered by fluctuating e-commerce demand, unforeseen disruptions, and diverse stakeholders with evolving objectives. This paper aims to evaluate the effectiveness of Physical Internet hubs (PI-hubs) in addressing LML challenges by developing an intelligent multi-agent system (iMAS) that focuses on stakeholders’ interactions. In the iMAS, carriers, shippers, and Physical Internet managers (PI-Managers) are considered learning agents. In this complex scenario, the distribution network (DN) structure is dynamic, transitioning from a single-tier system to a two-tier network when carriers and shippers utilize PI-hubs. Bayesian Q-learning optimizes action selection by balancing exploration and exploitation, while fair reward distribution aligns agent incentives, improving cooperation, stability, and performance in dynamic, multi-agent environments. Simulations involving varying combinations of learning agents are performed. Two delivery vehicle types are also included in the collaborative vehicle routing problem, forming the iMAS environment. The simulation results are compared with the base case where agents do not engage in learning. Findings suggest that when PI-managers engage in learning, there is an increase in the percentage of PI-hub usage and a decrease in total vehicle kilometers traveled (VKT), highlighting the effectiveness of PI-hubs in alleviating the adverse impacts of freight vehicle mobility within metropolitan areas. The impact of the initial PI-hub fee policy on DN efficiency, including PI-hub usage, VKT, carriers’ and shippers’ costs, and PI-Manager profit, is assessed through extensive sensitivity analysis. The iMAS acts as a decision support system enabling policymakers to evaluate various policies and actions, aiding the identification of optimal decisions within the LML framework.

Suggested Citation

  • Kahalimoghadam, Masoud & Thompson, Russell G. & Rajabifard, Abbas, 2025. "An intelligent multi-agent system for last-mile logistics," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 200(C).
    • Handle: RePEc:eee:transe:v:200:y:2025:i:c:s1366554525002327
    DOI: 10.1016/j.tre.2025.104191
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1366554525002327
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.tre.2025.104191?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Liu, Yubin & Ye, Qiming & Escribano-Macias, Jose & Feng, Yuxiang & Candela, Eduardo & Angeloudis, Panagiotis, 2023. "Route planning for last-mile deliveries using mobile parcel lockers: A hybrid q-learning network approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 177(C).
    2. Ardi Tampuu & Tambet Matiisen & Dorian Kodelja & Ilya Kuzovkin & Kristjan Korjus & Juhan Aru & Jaan Aru & Raul Vicente, 2017. "Multiagent cooperation and competition with deep reinforcement learning," PLOS ONE, Public Library of Science, vol. 12(4), pages 1-15, April.
    3. Luo, Chunlin & Zhou, Xiaoyang & Lev, Benjamin, 2022. "Core, shapley value, nucleolus and nash bargaining solution: A Survey of recent developments and applications in operations management," Omega, Elsevier, vol. 110(C).
    4. Shou, Yongyi & Wu, Chang & Shao, Jinan & Hu, Wenjin & Lai, Kee-hung, 2023. "Does green technology innovation contribute to logistics companies’ market value? The effects of stakeholder engagement and public attention," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 176(C).
    5. Eric Ballot & Olivier Gobet & Benoit Montreuil, 2012. "Physical Internet Enabled Open Hub Network Design for Distributed Networked Operations," Post-Print hal-00696956, HAL.
    6. Roberto Roson & Franz Hubert, 2015. "Bargaining Power and Value Sharing in Distribution Networks: A Cooperative Game Theory Approach," Networks and Spatial Economics, Springer, vol. 15(1), pages 71-87, March.
    7. Sakti, Sekar & Zhang, Lele & Thompson, Russell G., 2023. "Synchronization in synchromodality," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 179(C).
    8. Firdausiyah, N. & Taniguchi, E. & Qureshi, A.G., 2019. "Modeling city logistics using adaptive dynamic programming based multi-agent simulation," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 125(C), pages 74-96.
    9. Teodor Gabriel Crainic & Nicoletta Ricciardi & Giovanni Storchi, 2009. "Models for Evaluating and Planning City Logistics Systems," Transportation Science, INFORMS, vol. 43(4), pages 432-454, November.
    10. Yves Sallez & Shenle Pan & Benoit Montreuil & Thierry Berger & Eric Ballot, 2016. "On the activeness of intelligent Physical Internet containers," Post-Print hal-01491403, HAL.
    11. Si, Jinhua & He, Fang & Lin, Xi & Tang, Xindi, 2024. "Vehicle dispatching and routing of on-demand intercity ride-pooling services: A multi-agent hierarchical reinforcement learning approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 186(C).
    12. Eiichi Taniguchi & Russell G. Thompson & Ali G. Qureshi, 2023. "Overview of city logistics and urban freight transport operations," Chapters, in: Edoardo Marcucci & Valerio Gatta & Michela Le Pira (ed.), Handbook on City Logistics and Urban Freight, chapter 7, pages 141-159, Edward Elgar Publishing.
    13. Taheri Tehrani, Mohammad & Afshin Hemmatyar, Ali Mohammad, 2019. "Welfare-aware strategic demand control in an intelligent market-based framework: Move towards sustainable smart grid," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    14. Benjamin Rolf & Ilya Jackson & Marcel Müller & Sebastian Lang & Tobias Reggelin & Dmitry Ivanov, 2023. "A review on reinforcement learning algorithms and applications in supply chain management," International Journal of Production Research, Taylor & Francis Journals, vol. 61(20), pages 7151-7179, October.
    15. Yan, Yimo & Chow, Andy H.F. & Ho, Chin Pang & Kuo, Yong-Hong & Wu, Qihao & Ying, Chengshuo, 2022. "Reinforcement learning for logistics and supply chain management: Methodologies, state of the art, and future opportunities," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 162(C).
    16. Sluijk, Natasja & Florio, Alexandre M. & Kinable, Joris & Dellaert, Nico & Van Woensel, Tom, 2023. "Two-echelon vehicle routing problems: A literature review," European Journal of Operational Research, Elsevier, vol. 304(3), pages 865-886.
    17. Balci, Gökcay & Surucu-Balci, Ebru, 2021. "Blockchain adoption in the maritime supply chain: Examining barriers and salient stakeholders in containerized international trade," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 156(C).
    18. Huo, Jinbiao & Liu, Chengqi & Chen, Jingxu & Meng, Qiang & Wang, Jian & Liu, Zhiyuan, 2023. "Simulation-based dynamic origin–destination matrix estimation on freeways: A Bayesian optimization approach," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 173(C).
    19. van Gils, Teun & Caris, An & Ramaekers, Katrien & Braekers, Kris & de Koster, René B.M., 2019. "Designing efficient order picking systems: The effect of real-life features on the relationship among planning problems," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 125(C), pages 47-73.
    20. Mühlbauer, Ferdinand & Fontaine, Pirmin, 2021. "A parallelised large neighbourhood search heuristic for the asymmetric two-echelon vehicle routing problem with swap containers for cargo-bicycles," European Journal of Operational Research, Elsevier, vol. 289(2), pages 742-757.
    21. Francesco Ciardiello & Andrea Genovese & Shucheng Luo & Antonino Sgalambro, 2023. "A game-theoretic multi-stakeholder model for cost allocation in urban consolidation centres," Annals of Operations Research, Springer, vol. 324(1), pages 663-686, May.
    22. Kahalimoghadam, Masoud & Thompson, Russell G. & Rajabifard, Abbas, 2024. "Determining the number and location of micro-consolidation centres as a solution to growing e-commerce demand," Journal of Transport Geography, Elsevier, vol. 117(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Peng, Xiaoshuai & Zhang, Lele & Thompson, Russell G. & Wang, Kangzhou, 2023. "A three-phase heuristic for last-mile delivery with spatial-temporal consolidation and delivery options," International Journal of Production Economics, Elsevier, vol. 266(C).
    2. Wu, Hang & Li, Ming & Yu, Chenglin & Ouyang, Zhiyuan & Lai, Kee-hung & Zhao, Zhiheng & Pan, Shenle & Wang, Shuaian & Zhong, Ray Y. & Kuo, Yong-Hong & Zhang, Fangni & Huang, Wenjie & Shen, Zuo-Jun Max , 2025. "Towards cyber-physical internet: A systematic review, fundamental model and future perspectives," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 197(C).
    3. Le Colleter, Théo & Dumez, Dorian & Lehuédé, Fabien & Péton, Olivier, 2023. "Small and large neighborhood search for the park-and-loop routing problem with parking selection," European Journal of Operational Research, Elsevier, vol. 308(3), pages 1233-1248.
    4. Rémy Dupas & Eiichi Taniguchi & Jean-Christophe Deschamps & Ali G. Qureshi, 2020. "A Multi-commodity Network Flow Model for Sustainable Performance Evaluation in City Logistics: Application to the Distribution of Multi-tenant Buildings in Tokyo," Sustainability, MDPI, vol. 12(6), pages 1-18, March.
    5. Sluijk, Natasja & Florio, Alexandre M. & Kinable, Joris & Dellaert, Nico & Van Woensel, Tom, 2023. "Two-echelon vehicle routing problems: A literature review," European Journal of Operational Research, Elsevier, vol. 304(3), pages 865-886.
    6. Jamal Alnsour & Abdullah Radwan Arabeyyat & Khalil Al-Hyari & Sakher A. I. Al-Bazaiah & Reeman Aldweik, 2023. "Enhancing City Logistics for Sustainable Development in Jordan: A Survey-Based Study," Logistics, MDPI, vol. 8(1), pages 1-14, December.
    7. Xiong, Xiaoyun & Han, Jialin & Yin, Yunqiang & Cheng, T.C.E., 2025. "An exact method for the two-echelon split-delivery vehicle routing problem for liquefied natural gas delivery with the boil-off phenomenon," European Journal of Operational Research, Elsevier, vol. 321(1), pages 123-146.
    8. Shuangyan Li & Yijing Liang & Zhenjie Wang & Dezhi Zhang, 2021. "An Optimization Model of a Sustainable City Logistics Network Design Based on Goal Programming," Sustainability, MDPI, vol. 13(13), pages 1-20, July.
    9. Dubey, Rameshwar & Gunasekaran, Angappa & Papadopoulos, Thanos, 2024. "Benchmarking operations and supply chain management practices using Generative AI: Towards a theoretical framework," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 189(C).
    10. Hongqi Li & Feilong Wang & Hanxi Xiong & Zhiqi Wang, 2025. "Two-echelon van-robot routing problem with sharing-curbside satellites," Journal of Heuristics, Springer, vol. 31(1), pages 1-35, March.
    11. Kim, Nayeon & Montreuil, Benoit & Klibi, Walid & Kholgade, Nitish, 2021. "Hyperconnected urban fulfillment and delivery," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 145(C).
    12. Raphaël Oger & Frederick Benaben & Matthieu Lauras, 2016. "A Platform to Support Collaboration and Agility in Logistics Web," Post-Print hal-02123699, HAL.
    13. Perez, Daniel & Zou, Bo & Farazi, Nahid Parvez, 2025. "Package delivery by electric vertical takeoff and landing aircraft? An attractiveness assessment," Journal of Air Transport Management, Elsevier, vol. 124(C).
    14. Ho, G.T.S. & Tang, Yuk Ming & Leung, Eric K.H. & Tong, P.H., 2025. "Integrated reinforcement learning of automated guided vehicles dynamic path planning for smart logistics and operations," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 196(C).
    15. Li, Jian & Cang, Lu & Wu, Yisheng & Zhang, Zhaotong, 2025. "Two-echelon collaborative many-to-many pickup and delivery problem for agricultural wholesale markets with workload balance," Omega, Elsevier, vol. 130(C).
    16. Muriel, Juan E. & Zhang, Lele & Fransoo, Jan C. & Villegas, Juan G., 2024. "A reinforcement learning framework for improving parking decisions in last-mile delivery," Other publications TiSEM b3811dad-50fa-486b-8255-3, Tilburg University, School of Economics and Management.
    17. Dumez, Dorian & Tilk, Christian & Irnich, Stefan & Lehuédé, Fabien & Olkis, Katharina & Péton, Olivier, 2023. "A matheuristic for a 2-echelon vehicle routing problem with capacitated satellites and reverse flows," European Journal of Operational Research, Elsevier, vol. 305(1), pages 64-84.
    18. Regal, Andrés & Gonzalez-Feliu, Jesús & Rodriguez, Michelle, 2023. "A spatio-functional logistics profile clustering analysis method for metropolitan areas," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 179(C).
    19. Fontaine, Pirmin, 2022. "The vehicle routing problem with load-dependent travel times for cargo bicycles," European Journal of Operational Research, Elsevier, vol. 300(3), pages 1005-1016.
    20. Dahimi, Aria & Lurkin, Virginie & Mohammadi, Mehrdad & Van Woensel, Tom, 2025. "A two-echelon vehicle routing problem with mobile satellites and multiple commodities," European Journal of Operational Research, Elsevier, vol. 326(1), pages 124-140.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transe:v:200:y:2025:i:c:s1366554525002327. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600244/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.