IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v13y2025i13p2039-d1683282.html
   My bibliography  Save this article

A Deep Reinforcement-Learning-Based Route Optimization Model for Multi-Compartment Cold Chain Distribution

Author

Listed:
  • Jingming Hu

    (School of Management, Sichuan Agricultural University, Chengdu 611130, China)

  • Chong Wang

    (School of Business and Tourism, Sichuan Agricultural University, Chengdu 611130, China)

Abstract

Cold chain logistics is crucial in ensuring food quality and safety in modern supply chains. The required temperature control systems increase operational costs and environmental impacts compared to conventional logistics. To reduce these costs while maintaining service quality in real-world distribution scenarios, efficient route planning is essential, particularly when products with different temperature requirements need to be delivered together using multi-compartment refrigerated vehicles. This substantially increases the complexity of the routing process. We propose a novel deep reinforcement learning approach that incorporates a vehicle state encoder for capturing fleet characteristics and a dynamic vehicle state update mechanism for enabling real-time vehicle state updates during route planning. Extensive experiments on a real-world road network show that our proposed method significantly outperforms four representative methods. Compared to a recent ant colony optimization algorithm, it achieves up to a 6.32% reduction in costs while being up to 1637 times faster in computation.

Suggested Citation

  • Jingming Hu & Chong Wang, 2025. "A Deep Reinforcement-Learning-Based Route Optimization Model for Multi-Compartment Cold Chain Distribution," Mathematics, MDPI, vol. 13(13), pages 1-17, June.
  • Handle: RePEc:gam:jmathe:v:13:y:2025:i:13:p:2039-:d:1683282
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/13/13/2039/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/13/13/2039/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Gilbert Laporte, 2009. "Fifty Years of Vehicle Routing," Transportation Science, INFORMS, vol. 43(4), pages 408-416, November.
    2. G. B. Dantzig & J. H. Ramser, 1959. "The Truck Dispatching Problem," Management Science, INFORMS, vol. 6(1), pages 80-91, October.
    3. Koç, Çağrı & Bektaş, Tolga & Jabali, Ola & Laporte, Gilbert, 2016. "Thirty years of heterogeneous vehicle routing," European Journal of Operational Research, Elsevier, vol. 249(1), pages 1-21.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Kate, Joeri ten & Teunter, Ruud & Kusumastuti, Ratih Dyah & van Donk, Dirk Pieter, 2017. "Bio-diesel production using mobile processing units: A case in Indonesia," Agricultural Systems, Elsevier, vol. 152(C), pages 121-130.
    2. A. Mor & M. G. Speranza, 2020. "Vehicle routing problems over time: a survey," 4OR, Springer, vol. 18(2), pages 129-149, June.
    3. Zhiping Zuo & Yanhui Li & Jing Fu & Jianlin Wu, 2019. "Human Resource Scheduling Model and Algorithm with Time Windows and Multi-Skill Constraints," Mathematics, MDPI, vol. 7(7), pages 1-18, July.
    4. Hatzenbühler, Jonas & Jenelius, Erik & Gidófalvi, Gyözö & Cats, Oded, 2023. "Modular vehicle routing for combined passenger and freight transport," Transportation Research Part A: Policy and Practice, Elsevier, vol. 173(C).
    5. Liu, Yiming & Yu, Yang & Baldacci, Roberto & Tang, Jiafu & Sun, Wei, 2025. "Optimizing carbon emissions in green logistics for time-dependent routing," Transportation Research Part B: Methodological, Elsevier, vol. 192(C).
    6. Letchford, Adam N. & Salazar-González, Juan-José, 2019. "The Capacitated Vehicle Routing Problem: Stronger bounds in pseudo-polynomial time," European Journal of Operational Research, Elsevier, vol. 272(1), pages 24-31.
    7. Ted Gifford & Tracy Opicka & Ashesh Sinha & Daniel Vanden Brink & Andy Gifford & Robert Randall, 2018. "Dispatch Optimization in Bulk Tanker Transport Operations," Interfaces, INFORMS, vol. 48(5), pages 403-421, October.
    8. Vidal, Thibaut & Crainic, Teodor Gabriel & Gendreau, Michel & Prins, Christian, 2013. "Heuristics for multi-attribute vehicle routing problems: A survey and synthesis," European Journal of Operational Research, Elsevier, vol. 231(1), pages 1-21.
    9. Baozhen Yao & Qianqian Yan & Mengjie Zhang & Yunong Yang, 2017. "Improved artificial bee colony algorithm for vehicle routing problem with time windows," PLOS ONE, Public Library of Science, vol. 12(9), pages 1-18, September.
    10. Karina Thiebaut & Artur Pessoa, 2023. "Approximating the chance-constrained capacitated vehicle routing problem with robust optimization," 4OR, Springer, vol. 21(3), pages 513-531, September.
    11. Shengbin Wang & Weizhen Rao & Yuan Hong, 2020. "A distance matrix based algorithm for solving the traveling salesman problem," Operational Research, Springer, vol. 20(3), pages 1505-1542, September.
    12. Ioannou, Petros & Giuliano, Genevieve & Dessouky, Maged & Chen, Pengfei & Dexter, Sue, 2020. "Freight Load Balancing and Efficiencies in Alternative Fuel Freight Modes," Institute of Transportation Studies, Working Paper Series qt3ns4b894, Institute of Transportation Studies, UC Davis.
    13. Michael Khachay & Yuri Ogorodnikov & Daniel Khachay, 2021. "Efficient approximation of the metric CVRP in spaces of fixed doubling dimension," Journal of Global Optimization, Springer, vol. 80(3), pages 679-710, July.
    14. Tan Yu & Yongpei Guan & Xiang Zhong, 2024. "Visiting nurses assignment and routing for decentralized telehealth service networks," Annals of Operations Research, Springer, vol. 341(2), pages 1191-1221, October.
    15. Pillac, Victor & Gendreau, Michel & Guéret, Christelle & Medaglia, Andrés L., 2013. "A review of dynamic vehicle routing problems," European Journal of Operational Research, Elsevier, vol. 225(1), pages 1-11.
    16. D. G. N. D. Jayarathna & G. H. J. Lanel & Z. A. M. S. Juman, 2022. "Industrial vehicle routing problem: a case study," Journal of Shipping and Trade, Springer, vol. 7(1), pages 1-27, December.
    17. Shih-Che Lo & Ying-Lin Chuang, 2023. "Vehicle Routing Optimization with Cross-Docking Based on an Artificial Immune System in Logistics Management," Mathematics, MDPI, vol. 11(4), pages 1-19, February.
    18. Gilbert Laporte, 2016. "Scheduling issues in vehicle routing," Annals of Operations Research, Springer, vol. 236(2), pages 463-474, January.
    19. Ines Sbai & Saoussen Krichen & Olfa Limam, 2022. "Two meta-heuristics for solving the capacitated vehicle routing problem: the case of the Tunisian Post Office," Operational Research, Springer, vol. 22(1), pages 507-549, March.
    20. Brandstätter, Christian & Reimann, Marc, 2018. "The Line-haul Feeder Vehicle Routing Problem: Mathematical model formulation and heuristic approaches," European Journal of Operational Research, Elsevier, vol. 270(1), pages 157-170.

    More about this item

    Keywords

    ;
    ;
    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:13:p:2039-:d:1683282. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.