Designing a Facial Expression Detection System to Determine the Level of Customer Satisfaction with K-Nearest Neighbor Method

Abstract

Facial expressions are one of the ways humans communicate to convey one's emotions to their communication partner nonverbally. Therefore, human facial expressions can be used for various purposes, one of which is knowing customer satisfaction. So far, customers of Bank Rakyat Indonesia (BRI) provide feedback on service quality using only a polling system, namely by filling out a criticism and suggestion form and then entering it in a suggestion box which is distinguished between satisfied and dissatisfied. However, such a method is less effective because it can be easily manipulated by customers and customers are often indifferent to the feedback. So that the improvement of service quality tends to be less effective. This research will design a system that can recognize human facial expressions to determine the level of customer satisfaction with input data in the form of video data taken by a webcam camera with the viola-jones method to detect faces and determine facial patterns. Then the facial data will be classified using the K-Nearest Neighbor method to determine the type of facial expression. Determination of the value of k will determine the success rate of facial expression detection. The processed data will be displayed on a liquid crystal display (LCD) and then stored in a MySQL database. The results showed that the accuracy of facial expression detection was 80.77% from 52 facial expression data.