IDEAS home Printed from https://ideas.repec.org/a/spr/annopr/v350y2025i1d10.1007_s10479-022-04668-6.html
   My bibliography  Save this article

Anticipatory scheduling of synchromodal transport using approximate dynamic programming

Author

Listed:
  • Arturo E. Pérez Rivera

    (University of Twente)

  • Martijn R. K. Mes

    (University of Twente)

Abstract

We study the problem of scheduling container transport in synchromodal networks considering stochastic demand. In synchromodal networks, the transportation modes can be selected dynamically given the actual circumstances and performance is measured over the entire network and over time. We model this problem as a Markov Decision Process and propose a heuristic solution based on Approximate Dynamic Programming (ADP). Due to the multi-period nature of the problem, the one-step look-ahead perspective of the traditional approximate value-iteration approach can make the heuristic flounder and end in a local-optimum. To tackle this, we study the inclusion of Bayesian exploration using the Value of Perfect Information (VPI). In a series of numerical experiments, we show how VPI significantly improves a traditional ADP algorithm. Furthermore, we show how our proposed ADP–VPI combination achieves significant gains over common practice heuristics.

Suggested Citation

  • Arturo E. Pérez Rivera & Martijn R. K. Mes, 2025. "Anticipatory scheduling of synchromodal transport using approximate dynamic programming," Annals of Operations Research, Springer, vol. 350(1), pages 95-129, July.
    • Handle: RePEc:spr:annopr:v:350:y:2025:i:1:d:10.1007_s10479-022-04668-6
    DOI: 10.1007/s10479-022-04668-6
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10479-022-04668-6
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10479-022-04668-6?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Hugo P. Simão & Jeff Day & Abraham P. George & Ted Gifford & John Nienow & Warren B. Powell, 2009. "An Approximate Dynamic Programming Algorithm for Large-Scale Fleet Management: A Case Application," Transportation Science, INFORMS, vol. 43(2), pages 178-197, May.
    2. Anny-del-Mar Agamez-Arias & José Moyano-Fuentes, 2017. "Intermodal transport in freight distribution: a literature review," Transport Reviews, Taylor & Francis Journals, vol. 37(6), pages 782-807, November.
    3. Dall'Orto, Leonardo Campo & Crainic, Teodor Gabriel & Leal, Jose Eugenio & Powell, Warren B., 2006. "The single-node dynamic service scheduling and dispatching problem," European Journal of Operational Research, Elsevier, vol. 170(1), pages 1-23, April.
    4. Lo, Hong K. & An, Kun & Lin, Wei-hua, 2013. "Ferry service network design under demand uncertainty," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 59(C), pages 48-70.
    5. Belgacem Bouzaiene-Ayari & Clark Cheng & Sourav Das & Ricardo Fiorillo & Warren B. Powell, 2016. "From Single Commodity to Multiattribute Models for Locomotive Optimization: A Comparison of Optimal Integer Programming and Approximate Dynamic Programming," Transportation Science, INFORMS, vol. 50(2), pages 366-389, May.
    6. Johan Woxenius, 2007. "Generic Framework for Transport Network Designs: Applications and Treatment in Intermodal Freight Transport Literature," Transport Reviews, Taylor & Francis Journals, vol. 27(6), pages 733-749, January.
    7. Gregory A. Godfrey & Warren B. Powell, 2002. "An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, II: Multiperiod Travel Times," Transportation Science, INFORMS, vol. 36(1), pages 40-54, February.
    8. Ghane-Ezabadi, Mohammad & Vergara, Hector A., 2016. "Decomposition approach for integrated intermodal logistics network design," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 89(C), pages 53-69.
    9. Zhang, M. & Pel, A.J., 2016. "Synchromodal hinterland freight transport: Model study for the port of Rotterdam," Journal of Transport Geography, Elsevier, vol. 52(C), pages 1-10.
    10. Arnt-Gunnar Lium & Teodor Gabriel Crainic & Stein W. Wallace, 2009. "A Study of Demand Stochasticity in Service Network Design," Transportation Science, INFORMS, vol. 43(2), pages 144-157, May.
    11. Ilya O. Ryzhov & Martijn R. K. Mes & Warren B. Powell & Gerald van den Berg, 2019. "Bayesian Exploration for Approximate Dynamic Programming," Operations Research, INFORMS, vol. 67(1), pages 198-214, January.
    12. Gregory A. Godfrey & Warren B. Powell, 2002. "An Adaptive Dynamic Programming Algorithm for Dynamic Fleet Management, I: Single Period Travel Times," Transportation Science, INFORMS, vol. 36(1), pages 21-39, February.
    13. Gianpaolo Ghiani & Emanuele Manni & Barrett W. Thomas, 2012. "A Comparison of Anticipatory Algorithms for the Dynamic and Stochastic Traveling Salesman Problem," Transportation Science, INFORMS, vol. 46(3), pages 374-387, August.
    14. Bai, Ruibin & Wallace, Stein W. & Li, Jingpeng & Chong, Alain Yee-Loong, 2014. "Stochastic service network design with rerouting," Transportation Research Part B: Methodological, Elsevier, vol. 60(C), pages 50-65.
    15. Macharis, C. & Bontekoning, Y. M., 2004. "Opportunities for OR in intermodal freight transport research: A review," European Journal of Operational Research, Elsevier, vol. 153(2), pages 400-416, March.
    16. SteadieSeifi, M. & Dellaert, N.P. & Nuijten, W. & Van Woensel, T. & Raoufi, R., 2014. "Multimodal freight transportation planning: A literature review," European Journal of Operational Research, Elsevier, vol. 233(1), pages 1-15.
    17. Justin C. Goodson & Barrett W. Thomas & Jeffrey W. Ohlmann, 2016. "Restocking-Based Rollout Policies for the Vehicle Routing Problem with Stochastic Demand and Duration Limits," Transportation Science, INFORMS, vol. 50(2), pages 591-607, May.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pérez Rivera, Arturo E. & Mes, Martijn R.K., 2017. "Anticipatory freight selection in intermodal long-haul round-trips," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 105(C), pages 176-194.
    2. Arturo E. Pérez Rivera & Martijn R. K. Mes, 2019. "Integrated scheduling of drayage and long-haul operations in synchromodal transport," Flexible Services and Manufacturing Journal, Springer, vol. 31(3), pages 763-806, September.
    3. Thibault Delbart & Yves Molenbruch & Kris Braekers & An Caris, 2021. "Uncertainty in Intermodal and Synchromodal Transport: Review and Future Research Directions," Sustainability, MDPI, vol. 13(7), pages 1-25, April.
    4. Meng, Qiang & Hei, Xiuling & Wang, Shuaian & Mao, Haijun, 2015. "Carrying capacity procurement of rail and shipping services for automobile delivery with uncertain demand," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 82(C), pages 38-54.
    5. Joris Wagenaar & Ioannis Fragkos & Rob Zuidwijk, 2021. "Integrated Planning for Multimodal Networks with Disruptions and Customer Service Requirements," Transportation Science, INFORMS, vol. 55(1), pages 196-221, 1-2.
    6. Qu, Wenhua & Rezaei, Jafar & Maknoon, Yousef & Tavasszy, Lóránt, 2019. "Hinterland freight transportation replanning model under the framework of synchromodality," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 131(C), pages 308-328.
    7. Ulmer, Marlin W. & Thomas, Barrett W., 2020. "Meso-parametric value function approximation for dynamic customer acceptances in delivery routing," European Journal of Operational Research, Elsevier, vol. 285(1), pages 183-195.
    8. Qian Dai & Jiaqi Yang & Dong Li, 2018. "Modeling a Three-Mode Hybrid Port-Hinterland Freight Intermodal Distribution Network with Environmental Consideration: The Case of the Yangtze River Economic Belt in China," Sustainability, MDPI, vol. 10(9), pages 1-26, August.
    9. Zhang, M. & Pel, A.J., 2016. "Synchromodal hinterland freight transport: Model study for the port of Rotterdam," Journal of Transport Geography, Elsevier, vol. 52(C), pages 1-10.
    10. Zolfagharinia, Hossein & Haughton, Michael, 2018. "The importance of considering non-linear layover and delay costs for local truckers," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 109(C), pages 331-355.
    11. Liu, Chuanju & Lin, Shaochong & Shen, Zuo-Jun Max & Zhang, Junlong, 2023. "Stochastic service network design: The value of fixed routes," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 174(C).
    12. Gumuskaya, Volkan & van Jaarsveld, Willem & Dijkman, Remco & Grefen, Paul & Veenstra, Albert, 2020. "Dynamic barge planning with stochastic container arrivals," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 144(C).
    13. Zhou, Shaorui & Zhang, Hui & Shi, Ning & Xu, Zhou & Wang, Fan, 2020. "A new convergent hybrid learning algorithm for two-stage stochastic programs," European Journal of Operational Research, Elsevier, vol. 283(1), pages 33-46.
    14. Baris Yildiz & Martin Savelsbergh, 2019. "Provably High-Quality Solutions for the Meal Delivery Routing Problem," Transportation Science, INFORMS, vol. 53(5), pages 1372-1388, September.
    15. Lyu, Zhongyuan & Huang, George Q., 2023. "Cross-docking based factory logistics unitisation process: An approximate dynamic programming approach," European Journal of Operational Research, Elsevier, vol. 311(1), pages 112-124.
    16. Jiahao Zhao & Xiaoning Zhu & Li Wang, 2020. "Study on Scheme of Outbound Railway Container Organization in Rail-Water Intermodal Transportation," Sustainability, MDPI, vol. 12(4), pages 1-18, February.
    17. Zhang, X. & Liu, X., 2022. "A two-stage robust model for express service network design with surging demand," European Journal of Operational Research, Elsevier, vol. 299(1), pages 154-167.
    18. Schmid, Verena, 2012. "Solving the dynamic ambulance relocation and dispatching problem using approximate dynamic programming," European Journal of Operational Research, Elsevier, vol. 219(3), pages 611-621.
    19. Zhang, Yimeng & Tan, Xiangrong & Gan, Mi & Liu, Xiaobo & Atasoy, Bilge, 2025. "Operational synchromodal transport planning methodologies: Review and roadmap," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 194(C).
    20. Rempel, M. & Cai, J., 2021. "A review of approximate dynamic programming applications within military operations research," Operations Research Perspectives, Elsevier, vol. 8(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:annopr:v:350:y:2025:i:1:d:10.1007_s10479-022-04668-6. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.