An Overview Of Sign Language Detection Using Wearable System

Abstract

This paper present a survey of sign language detection using wearable system by using various technology. These technology is used for deaf and dumb as they face many difficulties in their day to day life to communicate with world. As many people who are not deaf and dumb unable to understand the sign language .To make this possible these gloves are made so that a deaf and dumb people can communicate with normal people. The parameter used are flex sensors , Hand gloves , Bluetooth Module , Voice synthesizer ,Capacitive charge sensor , Microcontroller , Gyros, Lillypad. These device can store many unique gestures and translate it into text or speech. Thus the device will be low cost device and can be benefitted to many peoples. A lot of research work is done to improve efficiency and accuracy.

INTRODUCTION

It was always a serious problem for deaf and dumb people to communicate with each other but somehow they came up with sign language as a solution. Deaf and dumb people face problem in communication to normal person. As For communicating to each other, both need to have knowledge about sign language. Which is bit difficult scenario. Generally normal person can communicate with deaf and dumb people but as they are not aware of all the signs and terminologies it is difficult for them to communicate.

Save your time!
We can take care of your essay

• Proper editing and formatting
• Free revision, title page, and bibliography
• Flexible prices and money-back guarantee

Place an order

Normal speed of any deaf and dumb person of talking is more than normal person even after normal person learn sign language. There must be an intermediate system Hence proposed system will be a hand gloves based sign language to interpreter in following format.

LITETATURE SURVEY

Thus a glove is made so that a deaf and mute people can communicate with the normal people. This glove convert the sign language into text. A LCD display is attached to the glove when a person use sign language it convert sign into text which will be displayed on LCD so that the person can understand the sign. Some signs or gestures are stored in the database to identify the sign language. It consist of six flex sensors for sensing the movement of hand or finger bends and a microcontroller circuit which transmit signal to a Mini-LCD in order to display the resulting letter. Microcontroller is the heart of system

There are few limitation in the using of this hand glove as follows:

• Due to use of 4 inch flex sensor accuracy may be less.
• We can store only limited sign language.
• If someone is blind he can’t communicate with it because it converts sign into text.
• Sign language is converted into Text not in Speech.

Limitation

• The System is not portable.
• The system is not real time.
• Accuracy can be improved by connecting more sensors.

A Real Time Portable Sign Language Translation System

In this paper, the authors have presented a wireless hand gesture recognition glove for the Real time translation of Taiwanese sign language. The sign language was the most expressive way for the deaf and dumb people to connect to the outside world and make the communication way easy.

The authors have designed the most comfortable and impressive system for this people. They have divided the system architecture in two different parts

• Inertia sensors based system
• Video based system.

Method 1

In Inertia based system , the system consists of the glove, mobile device ,flex sensors and inertia sensors. The gesture recognizing glove and mobile device both are connected to each other through Bluetooth. The flex sensors are used to detect which fingers joints are bent. As they could not find it sufficient using flex sensors it was not giving the

proper accuracy. They also used inertia sensors for more gestures .The inertia sensors and the flex sensors are used as sensing components of the System to generate the input signals. The periodically generated signals are stored in the queue first, then the stored signals will be processed by the algorithm to calculate the repeated times of hand gestures in sequence.

Method 2

In video based system, A hand tracking as well as 3D motion trajectory is used. It also consists of hand tracking camera and 3D motion trajectory database. Firstly the 3D motion is detected with the sign language in database and then compared with hand tracking camera and then the results are displayed on the screen.

Technology

Hand talk Implementation of a gesture recognizing Glove is developed for creating artificial voice with the help of following gestures. For creating artificial voice all the devices are setup on a hand gloves .This Gloves was created by electronic visualization lab. This Gloves was first commercially used by Nintendo Entertainment system named after Nintendo Power Glove in year 1987.

For creating artificial voice the devices like sensors are fitted or setup on the glove. The sensors used are:

• Flex sensors.
• Bluetooth module
• Micro controller

This Technology is also able to character recognition along able to character recognition along with learning algorithm to learn new symbols and gestures. This gloves can also be fitted with extra sensors like gyros and accelerometer for calculating the position of hands and palm and able to make new gesture. As one gesture can have one or more meaning. So accelerometer can be used.

Sign language detection devices are available and typically limited in portability, it also requires a sophisticated and heavy computation make this devices expensive and bulky unsuitable of in-field application[5].

In this paper they present a glove which is based on the charge transfer touch sensors which translate the American Sign Language into the words, the translation is based on the charged touch sensor which gives an binary detection system which gives an set of digital touch sensor instead of a analog signal.

In this Glove based technology the capacitive touch sensors are mounted on the finger tips of the each finger and they are selectively activated which causes an wide range of the selection, the combination of sequence is generated from the glove which gives an output as an character which can be further combine by the processing unit to form the words and those words are form an sentences. The Processing unit processes an input by using various type of algorithm to process the data.

This devices assign specific binary values of the each character which can be used for recognition of all 26 English alphabets and 10 numeric digits signed in the American sign language (ASL).

CONCLUSION

In this review paper, different techniques of sign language recognition are reviewed on the basis of sign acquiring methods and sign identification methods. For sign acquiring methods, vision based methods and for sign identification methods, artificial neuron network proves a strong candidature.

REFERENCES

1. Hanine Elhayek, Jessica Nacouzi, Abdallah Kaseem, Mustafa Hamad, Sami El-Murr “Sign To Letter Translator System Using Hand Glove”, International IEEE @2014
2. Dheeraj gupta, pankhuri Singh, Khushbu Pandey, Jaya Solankhi ”Design And Development Of A Low Cost Electronic Hand Glove For Deaf And Blind”, IEEE@2015
3. Lih-jen Kau, Wan-Lin Su, Pei-ju yu, Sin-Jhan Wei “Real Time Portable Sign Translation System ”
4. Celestine Preetham, Girish Ramakrishnan, Sujan Kumar, Anish Tamse, Dr. Nagendra Krishnapura, ”Hand Talk Implimentation Of A Gesture Regognizing Glove”, IEEE@2013
5. Kalpattu S. Abhishek, Lee chumn Fai Qubely, Derek Ho , “Glove Based Hand Gesture Recognition Sign Language Translator Using Capacitive Touch Sensor ” IEEE@2016