Sign Language to Text Conversion System using Flex Sensors and Arduino

Introduction

This project aims to address the communication gap between the deaf and dumb community in India by converting sign language into text. The system utilizes flex sensors to monitor the amount of bend on the fingers, which are commonly used in sign language gestures. The flex sensors change resistance depending on the finger's bend, and the data from these sensors is sent to the Arduino, acting as the control unit.

The Arduino then performs analog-to-digital conversion on the received sensor data, compares it with the pre-stored values corresponding to specific sign language gestures, and finally displays the corresponding text on the LCD screen. This system allows non-sign language users to understand and communicate with the deaf and dumb population easily.

Components

• Flex Sensors: These sensors are used to detect the amount of bend on the fingers during sign language gestures.

• Arduino Board: The Arduino acts as the control unit, receiving data from the flex sensors, processing it, and displaying the results on the LCD.

• LCD Screen: The LCD screen displays the converted text, allowing non-sign language users to understand the gestures.

• Power Supply: A suitable power supply to provide the necessary voltage for operating the system.

How It Works

1. Flex sensors are attached to the fingers of the user, and they change their resistance based on finger bend.

2. The analog signals from the flex sensors are fed into the Arduino.

3. The Arduino performs analog-to-digital conversion on the incoming signals to convert them into a digital format.

4. The Arduino compares the obtained digital values with pre-stored values representing different sign language gestures.

5. Once a match is found, the corresponding text representation of the sign language gesture is retrieved.

6. The Arduino then displays the text on the connected LCD screen for easy comprehension.

Setup and Installation

1. Connect the flex sensors to the appropriate analog input pins on the Arduino board.

2. Connect the LCD screen to the Arduino, ensuring proper connections for data and control signals.

3. Upload the Arduino code (sketch) responsible for reading sensor data, processing it, and displaying the text to the Arduino board.

4. Calibrate the system by capturing and storing the resistance values for different finger bend angles during sign language gestures.

5. Once the calibration is complete, the system is ready to convert sign language gestures to text.

Usage

1. The user wears the flex sensors on their fingers.

2. The flex sensors continuously measure the finger bend angles and send the data to the Arduino.

3. When the user performs a sign language gesture, the Arduino processes the sensor data and converts it into text.

4. The converted text is displayed on the LCD screen, allowing non-sign language users to understand the intended message.

Benefits

• Facilitates communication between the deaf and dumb community and non-sign language users.

• Enables the deaf and dumb population to express themselves more effectively.

• Increases inclusivity and accessibility for the deaf and dumb population in various settings.

Conclusion

The Sign Language to Text Conversion System using Flex Sensors and Arduino provides a valuable solution to bridge the communication gap between the deaf and dumb community and the rest of society. By converting sign language gestures into easily understandable text, this system enhances communication and fosters inclusivity, ultimately contributing to a more connected and empathetic society.