Abstract

<p class="0abstract">Sign language is a main mode of communication for vocally disabled. This language use set of representation which is finger sign, expression or mixture of both to express their information among others. This system presents a novel approach for mobile application based translation of sign action analysis, recognition and generating a text description in Kannada language. Where it uses two important steps training and testing. In training set of 50 different domains of video samples are collected, each domain contains 5 samples and assign a class of words to each video sample and it will be store in database. Where in testing test sample under goes preprocessing using median filter, canny operator for edge detection, HOG for feature extraction. SVM takes input as a HOG features and predict the class label based on trained SVM model. Finally the text description will be generated in Kannada language. The average computation time is minimum and with acceptable recognition rate and validate the performance efficiency over the conventional model.</p>

Highlights

  • The activity recognition aims to recognize the actions and goals of one or more agents from a series of observations on the agents' actions and the environmental conditions

  • The problem of video representation is considered that means how to encode videos in a robust way? Which type of representation is suitable for a wide variety of action classes, tasks and video types? This paper shows the system which is used for recognition of hand gesture of sign language and translate it into corresponding in Kannada language

  • The frame data are extracted based on the frame reading rate and multiple frames are processed in successive format to extract the region of interest

Read more

Summary

Introduction

The activity recognition aims to recognize the actions and goals of one or more agents from a series of observations on the agents' actions and the environmental conditions. The gesture based communication correspondence understanding includes semantic examination of hands taking after, hands shapes, hands presentations, sign verbalization with basic etymological information talked with head advancements and outward appearances. The huge inconvenience in signal based correspondence affirmation stood out from talk affirmation is to see at the same time assorted correspondence properties of a guarantor, for instance, hands and body advancement, external appearances and body act. These property must be viewed as at the same time for a better than average affirmation structure.

Literature Outline
System Overview
Training Phase
Testing Phase
System Implementation
Preprocessing
Feature Extraction
Classification
Algorithm for Implementation
Block Normalization
Results and Discussion
Result Analysis for Video Samples
Analysis of Overall Videos
Analysis of Processing Time
Analysis of Recognition Rate for Trained Video
Conclusion
Authors
Full Text
Paper version not known

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call

Disclaimer: All third-party content on this website/platform is and will remain the property of their respective owners and is provided on "as is" basis without any warranties, express or implied. Use of third-party content does not indicate any affiliation, sponsorship with or endorsement by them. Any references to third-party content is to identify the corresponding services and shall be considered fair use under The CopyrightLaw.