Author
Listed:
- Yash Saxena
- Srishti Jaiswar
- Deepak Arya
- Vipul Singh
- Hemani Sharma
Abstract
Despite significant advances in computer vision and deep learning, real-time sign language translation remains constrained by limited vocabulary coverage, high computational cost, and weak integration between recognition and language generation. This study introduces SignBridge, a real-time sign language to text and speech translation system that combines lightweight visual processing with sequence-based deep learning to enable accessible communication between signers and non signers. The proposed system captures live video input and extracts hand landmarks using MediaPipe, transforming raw visual data into structured temporal sequences. These sequences are modeled using a Long Short-Term Memory (LSTM) network to learn motion dynamics and classify gestures within a predefined vocabulary. To address instability in real-time inference, the system incorporates confidence filtering and temporal smoothing, ensuring consistent predictions under varying input conditions. Recognized gestures are subsequently mapped to textual output and synthesized into speech, forming an end-to-end multimodal communication pipeline. The system was developed and evaluated using a subset of the WLASL dataset, which provides diverse, realworld signing conditions across multiple users. Experimental observations demonstrate that the proposed approach achieves stable recognition performance and low-latency response suitable for real-time interaction, while maintaining computational efficiency through landmark-based feature representation. However, the system currently operates at a word-level classification stage and does not fully capture the grammatical complexity of continuous sign language. This work delivers a real-world, scalable way to interpret sign language in real time, focusing on the balance between accuracy, speed, and how easily you can put it into practice. By combining gesture recognition with instant text and speech output, it pushes assistive communication technology forward. It also points out important paths for future research, like nonstop translation, blending different types of signals, and handling bigger vocabularies.
Suggested Citation
Yash Saxena & Srishti Jaiswar & Deepak Arya & Vipul Singh & Hemani Sharma, 2026.
"SignBridge: A Real-Time Sign Language to Speech and Text Translation System for Accessible Communication,"
International Journal of Scientific Research in Artificial Intelligence and Machine Learning, International Journal of Scientific Research in Artificial Intelligence and Machine Learning, vol. 2(2), pages 41-54, April.
Handle:
RePEc:jbo:ijsrml:v2:y2026:i2:id:15
Note: Article URL: https://ijsraiml.com/home/article/view/IJSRAIML26226
Download full text from publisher
Corrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:jbo:ijsrml:v2:y2026:i2:id:15. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
We have no bibliographic references for this item. You can help adding them by using this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Pankaj Sharma (email available below). General contact details of provider: https://ijsraiml.com/home .
Please note that corrections may take a couple of weeks to filter through
the various RePEc services.