Download the dataset here: https://www.kaggle.com/birdy654/sign-language-recognition-leap-motion

Collect your own multi-modality dataset via this script: https://github.com/jordan-bird/Leap-Motion-Dataset-Collector

The dataset contains gestures recorded from the Leap Motion device for 18 different phrases in both British Sign Language and American Sign Language. The BSL dataset comes from five subjects and the ASL dataset comes from two subjects.

This script was used in part for data collection in:

Bird, Jordan J., Aniko Ekart, and Diego R. Faria. “British Sign Language Recognition via Late Fusion of Computer Vision and Leap Motion with Transfer Learning to American Sign Language.” (2020).

In this work, we use a multi-modality approach to improve sign language recognition via inputting camera images and Leap Motion data to a branched neural network and performing late fusion.