Abstract

Aiming at the insufficient feature extraction in the expression feature extraction stage of traditional convolutional neural network and the misclassification of mislabeled samples, an expression recognition and robot intelligent interaction method using deep learning is proposed. First, in image preprocessing, the dimension of the color image is reduced by image gray adjustment to reduce the amount of calculation, the shadow interference is eliminated by the average method, and the image is enhanced by histogram equalization. Second, multichannel convolution is used to replace the single convolution size in the second convolution layer in AlexNet, the Global Average Pooling layer is introduced to replace the fully connected layer, and Batch Normalization is introduced to improve the feature extraction ability of the model and avoid gradient explosion. Finally, the Focal Loss is improved by setting the probability threshold to avoid the impact of mislabeling samples on the classification performance of the model. The experimental results show that the recognition accuracy of the model on FER2013 data set is 98.36%. The effectiveness of the algorithm is verified on the intelligent interactive system of service robot based on expression recognition. Compared with other expression recognition methods, the proposed method can extract more expression features and recognize facial expression more accurately.

Highlights

  • With the progress of society and the continuous development of science and technology, people pay more and more attention to intelligent robots and related fields. e wide application of robots and people’s demand for robots promote the development of robot technology in a more intelligent direction [1]

  • In recent years, according to the requirements of China’s national high-tech research and development plan in “13th five-year plan,” in order to implement the “made in China 2025,” robots will be taken as the key development field, and the overall deployment has been made the research on service robot has been favored by many researchers and relevant research institutions, and it has become a hotspot in robot research [2,3,4]

  • Reference [26] proposed a method to improve the fusion of convolutional neural network and attention mechanism, which integrated the global image features with multiple unobstructed facial regions of interest features, so as to improve the expression ability of regional features

Read more

Summary

Introduction

With the progress of society and the continuous development of science and technology, people pay more and more attention to intelligent robots and related fields. e wide application of robots and people’s demand for robots promote the development of robot technology in a more intelligent direction [1]. In the field of human-computer interaction, intelligent interaction can be realized, so facial expression recognition technology has high scientific research and application value. 2. Related Researches e research of expression recognition can be mainly divided into traditional feature extraction methods and deep learning methods. Many scholars have applied deep learning method to facial expression recognition and achieved good results. Reference [26] proposed a method to improve the fusion of convolutional neural network and attention mechanism, which integrated the global image features with multiple unobstructed facial regions of interest features, so as to improve the expression ability of regional features. Aiming at the insufficient feature extraction in the expression feature extraction stage of traditional convolutional neural network and the misclassification of mislabeled samples, an expression recognition and robot intelligent interaction method using deep learning is proposed. Focal Loss is improved by setting the probability threshold to avoid the impact of mislabeling samples on the classification performance of the model

Facial Expression Recognition Based on Convolutional Neural Network
Experiment and Analysis
Findings
Conclusion
Full Text
Published version (Free)

Talk to us

Join us for a 30 min session where you can share your feedback and ask us any queries you have

Schedule a call