A Privacy-Preserving RL-Based Secure Charging Coordinator Using Efficient FL for Smart Grid Home Batteries

Smart power grids (SGs) enhance efficiency, reliability, and sustainability by integrating distributed energy resources (DERs) such as solar panels and wind turbines. A key challenge in SGs is managing home battery charging during periods of insufficient renewable energy generation to ensure fairness, efficiency, and customer satisfaction. This paper introduces a secure reinforcement learning (RL)-based framework for optimizing battery charging coordination while addressing privacy concerns and false data injection (FDI) attacks. Privacy is preserved through Federated Learning (FL), enabling collaborative model training without sharing sensitive State of Charge (SoC) data that could reveal personal routines. To combat FDI attacks, Deep Learning (DL)-based detectors are deployed to identify malicious SoC data manipulation. To improve FL efficiency, the Change and Transmit (CAT) technique reduces communication overhead by transmitting only model parameters that experience enough change comparing to the last round. Extensive experiments validate the framework’s efficacy. The RL-based charging coordinator ensures fairness by maintaining SoC levels within thresholds and reduces overall power utilization through optimal grid power allocation. The CAT-FL approach achieves up to 93.5% communication overhead reduction, while DL-based detectors maintain high accuracy, with supervised models reaching 99.84% and anomaly detection models achieving 92.1%. Moreover, the RL agent trained via FL demonstrates strong generalization, achieving high cumulative rewards and equitable power allocation when applied to new data owners which did not participate in FL training. This framework provides a scalable, privacy-preserving, and efficient solution for energy management in SGs, offering high accuracy against FDI attacks and paving the way for the future of smart grid deployments.