Physics-Informed TD3 Scheduling for PEMFC-Based Building CCHP Systems with Hybrid Electrical–Thermal Storage Under Load Uncertainty

This study addresses the optimal scheduling of a proton exchange membrane fuel cell (PEMFC)-based building combined cooling, heating, and power (CCHP) system, aiming to improve operational efficiency and flexibility under coupled electricity–thermal–cooling demands and load uncertainty. A physics-informed scheduling environment was developed using component models and multi-energy balance constraints, including a PEMFC with waste-heat recovery, a lithium bromide absorption chiller, a reversible heat pump with condenser heat recovery to thermal storage, a battery energy storage system, and a hot-water thermal storage tank. The dispatch problem was formulated as a Markov decision process and solved using deep reinforcement learning with TD3; performance was evaluated on typical summer and winter days, and robustness was tested by generating 100 scenarios with 30% demand perturbations. The results show that TD3 learns coordinated multi-energy dispatch patterns consistent with seasonal operation and reduces hydrogen consumption relative to a rule-based strategy under uncertainty while requiring millisecond-level inference time. Dynamic programming achieved slightly lower hydrogen consumption but incurred orders-of-magnitude higher computation time. Overall, TD3 provides a practical trade-off between near-optimal performance, robustness, and real-time applicability for PEMFC-based building CCHP scheduling.