Hand-Gesture Detection Using Principal Component Analysis (PCA) and Adaptive Neuro-Fuzzy Inference System (ANFIS)

Abstract

Sign language is a non-verbal language that Deaf persons exclusively count on to connect with their social environment.The problem that occurs in two-way communication using sign language is a misunderstanding when learning new terms that need to be taught to deaf and mute people. To minimize these misunderstandings, a system is needed that can assist in correcting hand gestures so that there is no misinterpretation in teaching new terms. Several optimality properties of PCA have been identified namely: variance of extracted features is maximized; the extracted features are uncorrelated; finds best linear approximation in the mean-square sense and maximizes information contained in the extracted feature. The classification uses the Adaptive Neuro-Fuzzy Inference System (ANFIS) method. From the results of experiments with different image size variables, the largest accuracy was obtained with an image size of 449x449 of 76.20%. While the lowest accuracy of 52.38% is obtained through scenarios with image sizes of 57x57 and 45x45. Therefore, differences in the use of image sizes have an influence on the accuracy of hand signal prediction. The smaller the size given, the smaller the accuracy obtained. This is indicated by the decreasing accuracy value when given a smaller size in the four scenarios that have been studied.