Indo-Pak Sign Language Translator Using Kinect

The capability of a gesture recognition using input device Kinect is explored. There is a continuous need to communicate using sign languages, such as interacting with people who have hearing and speech impairment. The situations are when silent communication is favored. For the sample, during a surgery, a surgeon may signal to the nurse for assistance and requirement of medical tools. It is difficult for most people to communicate with deaf/dumb people who are not acquainted with a sign language without an interpreter. Therefore, a combination of software and hardware that converts sign languages into plain text and then to speak can help with real-time communication, and it also provides interactive training for people to learn a sign language and communicate with the people having speech and hearing impairment. Here in our project Hand gesture recognition system can be divided into two parts according to its processing steps: hand detection, and gesture recognition and we will achieve this detection and recognition using depth sensor of Kinect (a line of motion sensing input device). The Kinect has an infrared blaster which is used for depth measurement. The paper is not only aimed at converting the sign language into voice but also can be useful for controlling different appliances using the gesture. To overcome these disabilities this project can be used efficiently.