Skip to content

In this project, we have developed 'Smart Glove' - a sign language translator. It consists of both hardware and software modules for translation and prediction analysis. We perform real-time translation of hand gesture into speech and text. In this project, we have used different machine learning models for prediction analysis including KNN, SVM…

License

Notifications You must be signed in to change notification settings

WaniaKhance/Smart-Glove-Sign-Language-Translator

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Smart Glove - Sign LanguageTranslator

Awarded 3rd Prize for Best Project @ Bahria University:3rd_place_medal:

  • Introduction

Communication is a fundamental aspect of human life, speech-impaired people depend on the other means of communication like sign language (a non verbal form of intercourse). To bridge this communication gap, it is important to have an advance sign-language detection and gesture recognition system for people in the community when they try to engage in interaction with normal public that do not understand sign-language. In this project, we have developed 'Smart Glove' - a sign language translator. It consists of both hardware and software modules for translation purpose. We perform real-time translation of hand gesture into speech and text. In this project, we have used different machine learning models for prediction analysis including KNN, SVM, Decision Tree, Naive Bayes, Random Forest and Logistic Regression.

We have collected a dataset by ourselves and provided in the documents.


For Hardware:

We have used

  1. Cotton glove
  2. Arduino microprocessor: receives analog data from different sensors and process it for further analysis.
  3. Flex sensors: determine the bending of each finger of one hand and sends data to microprocessor
  4. Wifi module: connects arduino to the computer/laptop device for wireless communication between glove and the device.
  5. Gyroscope: determines the angular position of the hand in space and sends three plane x, y and z-axis values to microprocessor.
  6. Electrical wires: for connection of different sensors, wifi module and microprocessor.

For Software:

  1. Arduino IDE
  2. Anaconda - Spyder IDE
  • Requirements

The provided code works in all python versions above 3.7.0.

  • Installation

There are few libraries that need to be installed which are given in the code file.

  • Code Details

  1. Arduino.ino file: reads real-time data and transmit it to PC.
  2. Prediction using ML file: Trains Machine Learning models over the dataset and save them in a folder.
  3. Load Models file: apply saved ML models on to the real-time data for gesture translation and prediction.

About

In this project, we have developed 'Smart Glove' - a sign language translator. It consists of both hardware and software modules for translation and prediction analysis. We perform real-time translation of hand gesture into speech and text. In this project, we have used different machine learning models for prediction analysis including KNN, SVM…

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published