IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v404y2026ics0306261925018999.html

Adaptive energy scheduling strategy for port logistics systems: A dual-consolidation continual reinforcement learning approach

Author

Listed:
  • Wang, Shiyu
  • Zheng, Yujing
  • Chen, Jing
  • Li, Zhaoxiang
  • Ji, Yuxiong
  • Du, Yuchuan

Abstract

The utilization of clean energy and microgrids offers significant opportunities for the green transition of port logistics systems. However, the dual uncertainties in energy generation and consumption pose challenges for typical rule- or model-based energy scheduling methods. This study investigates the dynamic interactions among clean energy generation, energy storage, the main grid, and energy consumption within a port microgrid, and proposes a dual-consolidation continual reinforcement learning (DC-CRL) framework for adaptive energy scheduling in real time. The framework incorporates elastic weight consolidation to protect core parameters of the value function and policy distillation to regularize policy outputs, mitigating catastrophic forgetting and enhancing long-term adaptability. Meanwhile, a rolling reward window is introduced to improve decision quality by encouraging globally optimal behavior, and a dynamic action space is employed to ensure physical feasibility, allowing the agent to adjust its actions in real time according to the state of the storage device. To verify the performance of the proposed approach, we construct key baselines, including a rule-based allocation strategy and a system-optimal strategy with perfect foresight. Experimental results based on Shanghai Yangshan Port demonstrate that DC-CRL achieves a 5.90 % improvement in economic and environmental performance and a 15.0 % enhancement in convergence speed compared with the baseline methods. The case study further provides wind–solar configuration recommendations to support intelligent microgrid control and green port development.

Suggested Citation

  • Wang, Shiyu & Zheng, Yujing & Chen, Jing & Li, Zhaoxiang & Ji, Yuxiong & Du, Yuchuan, 2026. "Adaptive energy scheduling strategy for port logistics systems: A dual-consolidation continual reinforcement learning approach," Applied Energy, Elsevier, vol. 404(C).
  • Handle: RePEc:eee:appene:v:404:y:2026:i:c:s0306261925018999
    DOI: 10.1016/j.apenergy.2025.127169
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261925018999
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2025.127169?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to

    for a different version of it.

    References listed on IDEAS

    as
    1. Douglas, Christopher M. & Shanbhogue, Santosh & Ghoniem, Ahmed & Zang, Guiyan, 2025. "Well-to-wake cost and emissions assessments for the Western Australia–East Asia green shipping corridor," Applied Energy, Elsevier, vol. 384(C).
    2. Rick M A Hollen & Frans A J van den Bosch & Henk W Volberda, 2015. "Strategic levers of port authorities for industrial ecosystem development," Maritime Economics & Logistics, Palgrave Macmillan;International Association of Maritime Economists (IAME), vol. 17(1), pages 79-96, March.
    3. K. H. Wu & J. Wu & L. Feng & B. Yang & R. Liang & S. Q. Yang & R. Zhao, 2020. "Study on Optimal Dispatching Strategy of Regional Energy Microgrid," Mathematical Problems in Engineering, Hindawi, vol. 2020, pages 1-23, October.
    4. Wu, Nianyuan & Zhang, Fang & Zhang, Fuzheng & Jiang, Chenxing & Lin, Jian & Xie, Shan & Jing, Rui & Zhao, Yingru, 2024. "An integrated multi-objective optimization, evaluation, and decision-making method for ship energy system," Applied Energy, Elsevier, vol. 373(C).
    5. Zhang, Chao & Yin, Wanjun & Wen, Tao, 2024. "An advanced multi-objective collaborative scheduling strategy for large scale EV charging and discharging connected to the predictable wind power grid," Energy, Elsevier, vol. 287(C).
    6. Li, Yang & Ma, Wenjie & Li, Yuanzheng & Li, Sen & Chen, Zhe & Shahidehpour, Mohammad, 2025. "Enhancing cyber-resilience in integrated energy system scheduling with demand response using deep reinforcement learning," Applied Energy, Elsevier, vol. 379(C).
    7. Zhang, Xizheng & Wang, Zeyu & Lu, Zhangyu, 2022. "Multi-objective load dispatch for microgrid with electric vehicles using modified gravitational search and particle swarm optimization algorithm," Applied Energy, Elsevier, vol. 306(PA).
    8. Elgamal, M. & Korovkin, Nikolay & Abdel Menaem, A. & Elmitwally, Akram, 2022. "Day-ahead complex power scheduling in a reconfigurable hybrid-energy islanded microgrid with responsive demand considering uncertainty and different load models," Applied Energy, Elsevier, vol. 309(C).
    9. Huang, Hongxu & Liang, Rui & Lv, Chaoxian & Lu, Mengtian & Gong, Dunwei & Yin, Shulin, 2021. "Two-stage robust stochastic scheduling for energy recovery in coal mine integrated energy system," Applied Energy, Elsevier, vol. 290(C).
    10. Ruan, Jiageng & Xia, Jing & Hu, Jingjing & Wan, He & Li, Ying & Qin, Yike, 2025. "Continuous learning energy management strategy design based on EWC-DDPG for electric vehicles," Energy, Elsevier, vol. 335(C).
    11. Zhang, Yue & Liang, Chengji & Shi, Jian & Lim, Gino & Wu, Yiwei, 2022. "Optimal Port Microgrid Scheduling Incorporating Onshore Power Supply and Berth Allocation Under Uncertainty," Applied Energy, Elsevier, vol. 313(C).
    12. Jiang, Haoran & Hong, Shaozhi & Wang, Zeling & Yu, Qing, 2025. "Integrated charging scheduling and energy management for electrified-autonomous flexible transit with energy storage systems design," Applied Energy, Elsevier, vol. 392(C).
    13. Li, Yang & Bu, Fanjin & Li, Yuanzheng & Long, Chao, 2023. "Optimal scheduling of island integrated energy systems considering multi-uncertainties and hydrothermal simultaneous transmission: A deep reinforcement learning approach," Applied Energy, Elsevier, vol. 333(C).
    14. Li, Zhaoxiang & Ma, Xu & Pan, Ruixu & Yang, Chao & Yuan, Quan, 2025. "Explaining the dynamics and identifying potential risks of hazardous materials truck movements," Journal of Transport Geography, Elsevier, vol. 123(C).
    15. Lv, Chaoxian & Yu, Hao & Li, Peng & Wang, Chengshan & Xu, Xiandong & Li, Shuquan & Wu, Jianzhong, 2019. "Model predictive control based robust scheduling of community integrated energy system with operational flexibility," Applied Energy, Elsevier, vol. 243(C), pages 250-265.
    16. Liang, Tao & Chai, Lulu & Cao, Xin & Tan, Jianxin & Jing, Yanwei & Lv, Liangnian, 2024. "Real-time optimization of large-scale hydrogen production systems using off-grid renewable energy: Scheduling strategy based on deep reinforcement learning," Renewable Energy, Elsevier, vol. 224(C).
    17. Liang, Tao & Chai, Lulu & Tan, Jianxin & Jing, Yanwei & Lv, Liangnian, 2024. "Dynamic optimization of an integrated energy system with carbon capture and power-to-gas interconnection: A deep reinforcement learning-based scheduling strategy," Applied Energy, Elsevier, vol. 367(C).
    18. Pengjun Zhao & Zhaoxiang Li & Zhangyuan He & Yilin Chen & Zuopeng Xiao, 2025. "Reducing the road freight emissions through integrated strategy in the port cities," Nature Communications, Nature, vol. 16(1), pages 1-14, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gao, Xianhui & Wang, Sheng & Sun, Ying & Zhai, Junyi & Chen, Nan & Zhang, Xiao-Ping, 2024. "Low-carbon energy scheduling for integrated energy systems considering offshore wind power hydrogen production and dynamic hydrogen doping strategy," Applied Energy, Elsevier, vol. 376(PA).
    2. Su, Kehan & Yang, Chao & Shao, Yuhao & Jiang, Dalin & Zhou, Can & Wang, Lijie & Liu, Dazheng & Zhu, Peiqi & Ding, Yi & Zheng, Chenghang & Gao, Xiang, 2025. "Accelerating multi-energy system online optimization via integer state variable prediction with operation strategy learning," Energy, Elsevier, vol. 341(C).
    3. Ren, Lina & Zhang, Kunpeng & Mehran, Kamyar & Ma, Kai, 2025. "Low-carbon economic dispatch of a hydrogen-based integrated energy system considering the coordinated operation of CHP-ORC-CSP and P2G-CCS," Energy, Elsevier, vol. 340(C).
    4. Li, Yang & Zhao, Bingsong & Li, Yuanzheng & Long, Chao & Li, Sen & Dong, Zhaoyang & Shahidehpour, Mohammad, 2025. "Safe-AutoSAC: AutoML-enhanced safe deep reinforcement learning for integrated energy system scheduling with multi-channel informer forecasting and electric vehicle demand response," Applied Energy, Elsevier, vol. 399(C).
    5. Han, Chunwei & Wu, Zhimin, 2025. "Cooperative robust optimization of hydrogen integrated energy systems for economic dispatch under uncertainty with bidirectional power conversion and progressive stepwise carbon emission trading mechanisms," Energy, Elsevier, vol. 335(C).
    6. Li, Wenzhuo & Li, Donghe & Hou, Shuo & Xi, Huan & Xiao, Yu & Yang, Qingyu, 2026. "Dual-scale optimization of integrated energy systems: a novel MAPPO-based approach for hybrid game equilibrium," Applied Energy, Elsevier, vol. 409(C).
    7. Jiankai Gao & Yang Li & Bin Wang & Haibo Wu, 2023. "Multi-Microgrid Collaborative Optimization Scheduling Using an Improved Multi-Agent Soft Actor-Critic Algorithm," Energies, MDPI, vol. 16(7), pages 1-21, April.
    8. He, Shangyang & Zhang, Suhan & Li, Yuanzheng & Gu, Wei & Chung, Chi-yung, 2026. "Physics-informed neural network for dynamic energy flow calculation in integrated electricity and gas systems," Applied Energy, Elsevier, vol. 407(C).
    9. Cui, Feifei & An, Dou & Xi, Huan & Ren, Zhigang, 2025. "Collaborative scheduling optimization of hydrogen-enhanced integrated energy system via goal-conditioned hierarchical reinforcement learning," Energy, Elsevier, vol. 338(C).
    10. Fan, Guozhu & Peng, Chunhua & Wang, Xuekui & Wu, Peng & Yang, Yifan & Sun, Huijuan, 2024. "Optimal scheduling of integrated energy system considering renewable energy uncertainties based on distributionally robust adaptive MPC," Renewable Energy, Elsevier, vol. 226(C).
    11. Han, Fengwu & Zeng, Jianfeng & Lin, Junjie & Gao, Chong & Ma, Zeyang, 2023. "A novel two-layer nested optimization method for a zero-carbon island integrated energy system, incorporating tidal current power generation," Renewable Energy, Elsevier, vol. 218(C).
    12. Wang, Zhewei & Yuan, Jie & Li, Yang & Zhang, Leiqi & Xie, Changjun & Zhu, Wenchao & Yang, Yang & Wang, Han, 2026. "A two-stage distributionally robust optimization approach for integrated energy systems: coordinated configuration of CCUS and hydrogen utilization," Energy, Elsevier, vol. 347(C).
    13. Wei, Ying'an & Fan, Jingjing & Meng, Qinglong & Debnath, Kumar Biswajit & Yang, Yuqin & Liu, Jiao & Lei, Yu, 2025. "EOLD: A reinforcement learning-based energy-optimised load disaggregation framework for demand-side energy management," Renewable Energy, Elsevier, vol. 252(C).
    14. Cheng, Hangyu & Chen, Jiahui & Jung, Seunghun & Kim, Young-Bae, 2025. "Hierarchical rolling optimization strategy for hybrid electric-hydrogen system based on deep reinforcement learning," Energy, Elsevier, vol. 338(C).
    15. Paulo M. De Oliveira-De Jesus & Jose M. Yusta, 2024. "Optimal Power Dispatch for Maximum Energy Community Welfare by Considering Closed Distribution Systems and Renewable Sources," Energies, MDPI, vol. 17(18), pages 1-21, September.
    16. Tan, Bifei & Lin, Zhenjia & Zheng, Xiaodong & Xiao, Fu & Wu, Qiuwei & Yan, Jinyue, 2023. "Distributionally robust energy management for multi-microgrids with grid-interactive EVs considering the multi-period coupling effect of user behaviors," Applied Energy, Elsevier, vol. 350(C).
    17. Shi, Jie & Wang, Luhao & Lee, Wei-Jen & Cheng, Xingong & Zong, Xiju, 2019. "Hybrid Energy Storage System (HESS) optimization enabling very short-term wind power generation scheduling based on output feature extraction," Applied Energy, Elsevier, vol. 256(C).
    18. Lan, Penghang & Chen, She & Li, Qihang & Li, Kelin & Wang, Feng & Zhao, Yaoxun, 2024. "Intelligent hydrogen-ammonia combined energy storage system with deep reinforcement learning," Renewable Energy, Elsevier, vol. 237(PB).
    19. Carrillo-Galvez, Adrian & Carmo, Felipe do & Soares, Tiago & Mourão, Zenaida & Ponomarev, Ilia & Araújo, João & Bandeira, Eduardo, 2025. "Electricity demand forecasting in green ports: Modelling and future research directions," Transport Policy, Elsevier, vol. 171(C), pages 1012-1024.
    20. Zheng, Ling & Zhou, Bin & Cao, Yijia & Wing Or, Siu & Li, Yong & Wing Chan, Ka, 2022. "Hierarchical distributed multi-energy demand response for coordinated operation of building clusters," Applied Energy, Elsevier, vol. 308(C).

    More about this item

    Keywords

    ;
    ;
    ;
    ;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:404:y:2026:i:c:s0306261925018999. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.