Video-based hand gesture recognition via SPD manifold spatial representation and optical flow motion features

Hand gesture recognition plays an important role in human–computer interaction, yet accurately modeling both spatial structure and temporal motion patterns in video-based vision systems remains challenging. Many existing approaches focus on either spatial appearance or motion information, which can limit their ability to capture the full complexity of dynamic hand gestures evolving over time. In this work, we present a unified feature representation framework that combines spatial descriptors modeled on the Symmetric Positive Definite (SPD) manifold with temporal motion features extracted from gesture video sequences using grid-based optical flow histograms in Euclidean space. Spatial covariance descriptors are mapped from the SPD manifold to a Euclidean space through the Log-Euclidean metric, enabling effective feature fusion while preserving intrinsic geometric properties. The resulting representation captures complementary spatial and temporal information in a compact and interpretable form. We evaluate the proposed framework on two publicly available video-based benchmark datasets for dynamic hand gesture recognition, the Cambridge Hand Gesture dataset and the Northwestern University Hand Gesture dataset. Experimental results demonstrate that the combined representation consistently improves classification performance compared to using spatial or temporal features alone, achieving 99.31% accuracy on the Cambridge dataset and 97.23% on the Northwestern dataset. These findings indicate that integrating manifold-aware spatial features with motion-based temporal cues provides a practical and effective solution for robust dynamic hand gesture recognition.