Deep learning optimisation for cardiology: Neural Architecture Search-driven arrhythmia classification with electrocardiograms

Cardiovascular disease is the leading cause of death worldwide. Sudden cardiac death (SCD) accounts for roughly 50% of all cardiac deaths. The electrocardiogram (ECG) is widely used for diagnosing cardiac disease. However, the complexity of interpretation limits the ECG’s efficacy. Modern deep learning methods can assist clinicians in diagnosis. We applied Neural Architecture Search (NAS) to identify optimal deep learning architectures for classifying cardiac arrhythmias with ECGs. We applied the Differentiable Architecture Search strategy to an AutoFormer search and trained, validated, and tested the resulting model on the PhysioNet Challenge 2021 (PC21) dataset (n = 88,253 from three continents). We optimised hyperparameters on the NAS output, exploring input patch size, class weighting, and loss function. The PC21 metric and the area under the receiver operating characteristic curve (AUROC) are the performance metrics. The NAS converged towards minimal architectural configurations (embedding dimension: 384, depth: 4, self-attention heads: 4, MLP ratio: 1) with a validation and test PC21 metric of 0.66 (PC21 winner: 0.63). The NAS-created network achieved an AUROC of 0.97 and a PC21 metric of 0.72 during testing (PC21 winner: 0.69). We tested the PC21 winner architecture (1D-convolutional neural network with attention mechanism) without the attention mechanism and with the NAS-suggested architecture of 4 self-attention heads (instead of 8). The architecture without the attention mechanism performed similarly to the one with 8 self-attention heads (AUROC: 0.90, PC21 metric: 0.69). The architecture with 4 self-attention heads scored an AUROC of 0.91 and improved the PC21 metric to 0.71. The attention mechanism visualisation for two SCD-related arrhythmias (premature ventricular contractions and prolonged QT-interval) showed more clinically relevant attention for the 4-self-attention-head architectures. We interpret architectural simplicity as driving performance in arrhythmia classification. The self-attention mechanism can autonomously abstract clinical representations, simplifying clinical deployment by eliminating the need for an explicit feature-extraction pipeline.