IDEAS home Printed from https://ideas.repec.org/a/eee/transe/v197y2025ics1366554525000870.html
   My bibliography  Save this article

Deep Q-network and knowledge jointly-driven ship operational efficiency optimization in a seaport

Author

Listed:
  • Guo, Wenqiang
  • Zhang, Xinyu
  • Ge, Ying-En
  • Du, Yuquan

Abstract

This study addresses a ship operational efficiency optimization problem for a seaport. Given the number of planned inbound ships, the problem optimizes the inbound sequence of all ships and their speed profiles at different inbound stages. A mixed-integer nonlinear programming model is presented to minimize both the total time of ships’ port entry process (TTEP) and the total fuel consumption (TFC) of the ships. A novel deep Q-network and knowledge jointly-driven cooperative metaheuristic algorithm (DQNKD-CMA) is designed to solve the model. Experimental results based on real scenarios set in Tianjin Port demonstrate that DQNKD-CMA exhibits favorable performance in solving the problem. The proposed method improves ship inbound efficiency and reduces carbon emissions through operational measures, providing a cost-effective alternative to energy-saving equipment and alternative fuels for ship emission mitigation. This study offers a significant set of implications to shipping and port operators who face new carbon emission reduction challenges.

Suggested Citation

  • Guo, Wenqiang & Zhang, Xinyu & Ge, Ying-En & Du, Yuquan, 2025. "Deep Q-network and knowledge jointly-driven ship operational efficiency optimization in a seaport," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 197(C).
    • Handle: RePEc:eee:transe:v:197:y:2025:i:c:s1366554525000870
    DOI: 10.1016/j.tre.2025.104046
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1366554525000870
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.tre.2025.104046?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Martin-Iradi, Bernardo & Pacino, Dario & Ropke, Stefan, 2024. "An adaptive large neighborhood search heuristic for the multi-port continuous berth allocation problem," European Journal of Operational Research, Elsevier, vol. 316(1), pages 152-167.
    2. Bin Zhang & Zhongyi Zheng & Deqiang Wang, 2020. "A model and algorithm for vessel scheduling through a two-way tidal channel," Maritime Policy & Management, Taylor & Francis Journals, vol. 47(2), pages 188-202, February.
    3. Alessandro Hill & Eduardo Lalla-Ruiz & Stefan Voß & Marcos Goycoolea, 2019. "A multi-mode resource-constrained project scheduling reformulation for the waterway ship scheduling problem," Journal of Scheduling, Springer, vol. 22(2), pages 173-182, April.
    4. Wang, Zhuang & Chen, Li & Wang, Bin & Huang, Lianzhong & Wang, Kai & Ma, Ranqi, 2023. "Integrated optimization of speed schedule and energy management for a hybrid electric cruise ship considering environmental factors," Energy, Elsevier, vol. 282(C).
    5. Alexander Senss & Onder Canbulat & Dogancan Uzun & Sefer Anil Gunbeyaz & Osman Turan, 2023. "Just in time vessel arrival system for dry bulk carriers," Journal of Shipping and Trade, Springer, vol. 8(1), pages 1-37, December.
    6. Shuai Jia & Qiang Meng & Haibo Kuang, 2022. "Equitable Vessel Traffic Scheduling in a Seaport," Transportation Science, INFORMS, vol. 56(1), pages 162-181, January.
    7. Liu, Baoli & Li, Zhi-Chun & Sheng, Dian & Wang, Yadong, 2021. "Integrated planning of berth allocation and vessel sequencing in a seaport with one-way navigation channel," Transportation Research Part B: Methodological, Elsevier, vol. 143(C), pages 23-47.
    8. Liu, Baoli & Li, Zhi-Chun & Wang, Yadong & Sheng, Dian, 2021. "Short-term berth planning and ship scheduling for a busy seaport with channel restrictions," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 154(C).
    9. Jianfeng Zheng & Xuejing Hou & Jingwen Qi & Lingxiao Yang, 2022. "Liner ship scheduling with time-dependent port charges," Maritime Policy & Management, Taylor & Francis Journals, vol. 49(1), pages 18-38, January.
    10. Wang, Shuaian & Meng, Qiang, 2012. "Sailing speed optimization for container ships in a liner shipping network," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 48(3), pages 701-714.
    11. Gao, Yuan & Sun, Zhuo, 2023. "Tramp ship routing and speed optimization with tidal berth time windows," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 178(C).
    12. Soroush Fatemi-Anaraki & Reza Tavakkoli-Moghaddam & Dorsa Abdolhamidi & Behdin Vahedi-Nouri, 2021. "Simultaneous waterway scheduling, berth allocation, and quay crane assignment: A novel matheuristic approach," International Journal of Production Research, Taylor & Francis Journals, vol. 59(24), pages 7576-7593, December.
    13. Shuai Jia & Chung-Lun Li & Zhou Xu, 2019. "Managing Navigation Channel Traffic and Anchorage Area Utilization of a Container Port," Transportation Science, INFORMS, vol. 53(3), pages 728-745, May.
    14. Du, Wei & Li, Yanjun & Shi, Jianxin & Sun, Baozhi & Wang, Chunhui & Zhu, Baitong, 2023. "Applying an improved particle swarm optimization algorithm to ship energy saving," Energy, Elsevier, vol. 263(PE).
    15. Abou Kasm, Omar & Diabat, Ali & Bierlaire, Michel, 2021. "Vessel scheduling with pilotage and tugging considerations," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 148(C).
    16. Se-Won Kim & Jeong-On Eom, 2023. "Ship Carbon Intensity Indicator Assessment via Just-in-Time Arrival Algorithm Based on Real-Time Data: Case Study of Pusan New International Port," Sustainability, MDPI, vol. 15(18), pages 1-28, September.
    17. Le Carrer, Noémie & Ferson, Scott & Green, Peter L., 2020. "Optimising cargo loading and ship scheduling in tidal areas," European Journal of Operational Research, Elsevier, vol. 280(3), pages 1082-1094.
    18. Fuqing Zhao & Xiaotong Hu & Ling Wang & Tianpeng Xu & Ningning Zhu & Jonrinaldi, 2023. "A reinforcement learning-driven brain storm optimisation algorithm for multi-objective energy-efficient distributed assembly no-wait flow shop scheduling problem," International Journal of Production Research, Taylor & Francis Journals, vol. 61(9), pages 2853-2871, May.
    19. Li, Shuqin & Jia, Shuai, 2019. "The seaport traffic scheduling problem: Formulations and a column-row generation algorithm," Transportation Research Part B: Methodological, Elsevier, vol. 128(C), pages 158-184.
    20. Zhijia Tan & Yadong Wang & Qiang Meng & Zhixue Liu, 2018. "Joint Ship Schedule Design and Sailing Speed Optimization for a Single Inland Shipping Service with Uncertain Dam Transit Time," Service Science, INFORMS, vol. 52(6), pages 1570-1588, December.
    21. Qiong Chen & Mengxing Huang & Qiannan Xu & Hao Wang & Jinghui Wang, 2020. "Reinforcement Learning-Based Genetic Algorithm in Optimizing Multidimensional Data Discretization Scheme," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-13, March.
    22. F.J. Sluiman, 2017. "Transit vessel scheduling," Naval Research Logistics (NRL), John Wiley & Sons, vol. 64(3), pages 225-248, April.
    23. Wei, Xiaoyang & Jia, Shuai & Meng, Qiang & Koh, Jimmy, 2024. "Dynamic tugboat deployment and scheduling with stochastic and time-varying service demands," Transportation Research Part B: Methodological, Elsevier, vol. 188(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Ke & Jin, Jian Gang & Zhang, Di & Ji, Sheng & Lee, Der-Horng, 2023. "A variable neighborhood search heuristic for real-time barge scheduling in a river-to-sea channel with tidal restrictions," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 179(C).
    2. Guo, Zijian & Cao, Zhen & Wang, Wenyuan & Jiang, Ying & Xu, Xinglu & Feng, Peng, 2021. "An integrated model for vessel traffic and deballasting scheduling in coal export terminals," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 152(C).
    3. Hao, Luyao & Jin, Jian Gang & Zhao, Ke, 2023. "Joint scheduling of barges and tugboats for river–sea intermodal transport," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 173(C).
    4. Liu, Baoli & Li, Zhi-Chun & Wang, Yadong, 2022. "A two-stage stochastic programming model for seaport berth and channel planning with uncertainties in ship arrival and handling times," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 167(C).
    5. Liu, Baoli & Wang, Xincheng & Wang, Zehao & Zheng, Jianfeng & Sheng, Dian, 2025. "Modeling and solving the joint berth allocation and vessel sequencing problem with speed optimization in a busy seaport," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 197(C).
    6. Liu, Baoli & Li, Zhi-Chun & Sheng, Dian & Wang, Yadong, 2021. "Integrated planning of berth allocation and vessel sequencing in a seaport with one-way navigation channel," Transportation Research Part B: Methodological, Elsevier, vol. 143(C), pages 23-47.
    7. Petris, Matteo & Pellegrini, Paola & Pesenti, Raffaele, 2022. "Models and algorithms for an integrated vessel scheduling and tug assignment problem within a canal harbor," European Journal of Operational Research, Elsevier, vol. 300(3), pages 1120-1135.
    8. Wei, Xiaoyang & Lau, Hoong Chuin & Xiao, Zhe & Fu, Xiuju & Zhang, Xiaocai & Qin, Zheng, 2025. "Bi-objective dynamic tugboat scheduling with speed optimization under stochastic and time-varying service demands," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 193(C).
    9. Milad Hematian & Jean-François Audy & Mikael Rönnqvist, 2025. "Pilot dispatching problem along a maritime corridor: a case study in the St. Lawrence River," Journal of Shipping and Trade, Springer, vol. 10(1), pages 1-33, December.
    10. Ziyun Wu & Bin Ji & Samson S. Yu, 2024. "Modeling and Solution Algorithm for Green Lock Scheduling Problem on Inland Waterways," Mathematics, MDPI, vol. 12(8), pages 1-25, April.
    11. Abou Kasm, Omar & Diabat, Ali & Bierlaire, Michel, 2021. "Vessel scheduling with pilotage and tugging considerations," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 148(C).
    12. Liu, Baoli & Li, Zhi-Chun & Wang, Yadong, 2023. "A branch-and-price heuristic algorithm for the bunkering operation problem of a liquefied natural gas bunkering station in the inland waterways," Transportation Research Part B: Methodological, Elsevier, vol. 167(C), pages 145-170.
    13. Shao, Shuai & Xu, Min & Tan, Zhijia & Zhen, Lu, 2024. "Ship deployment problem with green technology adoption for an inland river carrier under non-identical streamflow and speed limits," Transport Policy, Elsevier, vol. 157(C), pages 46-56.
    14. Zhen, Lu & Zhuge, Dan & Wang, Shuaian & Wang, Kai, 2022. "Integrated berth and yard space allocation under uncertainty," Transportation Research Part B: Methodological, Elsevier, vol. 162(C), pages 1-27.
    15. Tianhao Shao & Weijie Du & Yun Ye & Haoqing Li & Jingxin Dong & Guiyun Liu & Pengjun Zheng, 2024. "A Novel Virtual Arrival Optimization Method for Traffic Organization Scenarios," Sustainability, MDPI, vol. 16(1), pages 1-17, January.
    16. Wei, Xiaoyang & Jia, Shuai & Meng, Qiang & Tan, Kok Choon, 2020. "Tugboat scheduling for container ports," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 142(C).
    17. Wang, Yadong & Wang, Shuaian, 2021. "Deploying, scheduling, and sequencing heterogeneous vessels in a liner container shipping route," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 151(C).
    18. Zhen, Lu & Wu, Yiwei & Wang, Shuaian & Laporte, Gilbert, 2020. "Green technology adoption for fleet deployment in a shipping network," Transportation Research Part B: Methodological, Elsevier, vol. 139(C), pages 388-410.
    19. Li, De-Chang & Yang, Hua-Long, 2024. "Voyage charterparty arrangement for river tramp shipping: Green and traditional vessels comparison," Transport Policy, Elsevier, vol. 158(C), pages 75-92.
    20. Buonomano, Annamaria & Del Papa, Gianluca & Giuzio, Giovanni Francesco & Maka, Robert & Palombo, Adolfo & Russo, Giuseppe, 2025. "Design and retrofit towards zero-emission ships: Decarbonization solutions for sustainable shipping," Renewable and Sustainable Energy Reviews, Elsevier, vol. 213(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:transe:v:197:y:2025:i:c:s1366554525000870. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600244/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.