Author
Abstract
Federated learning enables privacy-preserving collaborative training across hospitals, yet the communication overhead of exchanging model parameters remains a critical deployment bottleneck. While gradient compression techniques have been extensively studied in distributed training, their effectiveness under the heterogeneous data distributions characteristic of multi-hospital settings is not well understood. This paper presents a controlled empirical comparison of six gradient compression strategies --- stochastic quantization (QSGD), ternary quantization (TernGrad), sign-based compression (signSGD), Top-K sparsification, Random-K sparsification, and a hybrid sparsification-quantization approach --- applied to federated medical image classification. Experiments are conducted on Fed-ISIC2019 with six natural hospital centers and PathMNIST with synthetic non-IID partitioning across five clients. Results indicate that Top-K sparsification with error feedback achieves the strongest accuracy--communication tradeoff, retaining 97.8% of the 200-round baseline accuracy at nominal 100× compression on Fed-ISIC2019. Multi-bit quantization methods remain more stable as data heterogeneity increases. Sign-based compression, evaluated under a different aggregation protocol (majority vote) than the other methods, degrades substantially under natural non-IID conditions. The hybrid approach performs strongly in the low-budget regime but introduces additional implementation complexity. Communication savings are reported as analytical estimates based on nominal compression ratios; protocol-level overhead would moderately reduce actual savings in deployment. These findings provide evidence-based guidance for healthcare institutions selecting compression strategies for bandwidth-constrained federated learning deployments.
Suggested Citation
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:dba:jsppaa:v:2:y:2026:i:3:p:13-25. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joseph Clark (email available below). General contact details of provider: https://pinnaclepubs.com/index.php/JSPP .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.