Atlassian Corporation
AUTOMATIC MACHINE RECOGNITION OF SIGN LANGUAGE GESTURES

Abstract:

Computer-implemented techniques are provided for machine recognition of gestures and transformation of recognized gestures to text or speech, for gestures communicate in a sign language such as American Sign Language (ASL). In an embodiment, a computer-implemented method comprises: storing a training dataset comprising a plurality of digital images of sign language gestures and an alphabetical letter assigned to each digital image of the plurality of digital images, training a neural network using the plurality of digital images of sign language gestures as input and the alphabetical letter assigned to each digital image as output, receiving a particular digital image comprising a particular sign language gesture, and using the trained neural network to classify the particular digital image as a particular alphabetical letter.