AttentionKAN-Based Multi-Agent Reinforcement Learning for Coordinated Battery Energy Storage Control in Residential Demand Response

Automated demand response in residential sectors is critical for grid stability, but centralized control strategies fail to address the unique energy profiles of individual households. This limitation becomes more pronounced in districts where buildings differ in load demand, photovoltaic (PV) production and battery energy storage system (BESS) behavior, while electricity prices and grid carbon intensity vary hourly. Conventional rule-based controllers can exploit patterns, but they require tuning and do not generalize across heterogeneous buildings. Existing centralized reinforcement learning methods improve adaptivity, yet they often learn compromise policies and scale poorly as the number of buildings increases. To address these issues, this paper proposes an AttentionKAN-based multi-agent reinforcement learning controller for district-level BESS scheduling. The method uses centralized training with decentralized execution, where each building is controlled by its own actor and a centralized critic models cross-building interactions through a multi-head query-key-value attention mechanism. To improve approximation accuracy under nonlinear and constrained battery dynamics, multilayer perceptron (MLP) blocks in the actor and critic are replaced with Kolmogorov-Arnold Networks (KANs), whose spline-parameterized univariate functions capture saturation effects, tariff discontinuities and couplings among state of charge, PV availability and carbon intensity. Implemented in CityLearn and evaluated on a residential net-zero community dataset, the proposed controller is assessed using building-level and district-level indicators for cost, CO 2 emissions, peak demand, ramping and load shape. The learned policy charges during solar-rich hours and discharges during evening peaks, achieving the strongest performance among benchmark controllers, including an approximately 50% cost reduction versus the reference case and emissions reduction. From a sustainability perspective, the results indicate that coordinated multi-building BESS control can support low-carbon residential electrification through emission reduction, lowering electricity expenditure and improving renewable-energy utilization and providing grid-supportive flexibility through reduced peaks and ramping.