Skip to content

Reads your hand signs and translates them to English words using Tensorflow object detection API

Notifications You must be signed in to change notification settings

rockyFierro/ASL-Input-Controls-ASL_to_English-

 
 

Repository files navigation

ASL Input Controls

Using translations made possible by the work of Nichola Renotte and Priyanjali Gupta; Uses handsigns detected by Tensorflow object detection and maps them to custom commands as an alternative to keyboards and videogame controllers.

Built on top of priiyaanjaalii0611/ASL_to_English Reads your hand signs and translates them to English words using Tensorflow object detection API
The model is built using transfer learning from pretrained model ssd_mobilenet model
The dataset is made manually by running the Image Collection python file that collects images from your webcam for all the mentioned below signs in the American Sign Language :

  • Hello ✋
  • I Love You 💙
  • Thank you 😺
  • Please 🥺
  • Yes ✔️
  • No ❎

The image annotations is done with the help of LabelImage file which you can use by simply git cloning the following:
Git link

The model was made only with help of Nicholas Renotte tutorial and Priyanjali Gupta

About

Reads your hand signs and translates them to English words using Tensorflow object detection API

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%