CNN and Stacked LSTM Model for Indian Sign Language Recognition

Abstract

In this paper, we propose a deep learning for sign language recognition using convolutional neural network (CNN) and long short term memory (LSTM). The architecture used CNN as a pretrained model for feature extraction and is passed to the LSTM for capturing spatio-temporal information. One more LSTM is stacked for increasing the accuracy. Deep learning model which captures temporal information is less. There is only less papers which deals with sign language recognition by using the deep learning architectures such as CNN and LSTM. The algorithm was tested in Indian sign language (ISL) dataset. We have presented the performance evaluation after testing with ISL dataset. Literature shows that deep learning models capturing temporal information is still an open research problem.