Broad-Deep Network-Based Fuzzy Emotional Inference Model with Personal Information for Intention Understanding

Abstract

A broad-deep fusion network-based fuzzy emotional inference model with personal information (BDFEI) is proposed for emotional intention understanding in human-robot interaction. It aims to understand students’ intentions in the university teaching scene. Specifically, feature extraction is carried out by convolution and maximum pooling, and then the ridge regression algorithm is used for emotional behavior recognition, which reduce the influence of the complex structure and slow network updates in deep learning. Multivariate analysis of variance is used to select the key personal information affecting the intention and obtain the coefficient of influence degree. Finally, fuzzy inference is used to understand the intention. According to the recognition results, the accuracy on FABO database of our proposal is 1.89%, 12.21% and 0.78% higher than those of the Residual Network combined with geodesic flow kernel (ResNet-101+GFK), a fuzzy deep neural network with sparse autoencoder (FDNNSA), and an affect recognition on a video-skeleton of bimodal information with a hierarchical classification fusion strategy (HCFS), respectively, indicating that our proposal can effectively capture the emotional intention of students in the teaching scene.