Application of Multi-sensory interaction design Based on Machine Learning in Virtual Reality

Abstract

Virtual reality (VR) technology is well-known to the public for its unparalleled sense of environmental immersion, which is accompanied by a large amount of human-computer interaction between users and objects in the virtual environment. Users transmit and obtain information through their senses, so the processing mechanism of information in various senses under the background of VR technology has become the foundation of research. In the process of natural information dissemination, users’ senses are synergistically involved, so whether there is a correlation between various senses that affects users’ final perception has become an important theoretical support for studying multi-sensory interaction. Facial expression recognition is an important component of multi-sensory interaction technology. Therefore, this article mainly uses machine learning algorithms to achieve real-time detection of facial targets in images or videos, as well as classification and recognition of facial expressions. To meet the task requirements of the expression recognition module, this article selects the DeepID network model based on deep learning in the field of facial recognition as the basic model for the expression recognition function. This study utilizes the excellent feature extraction ability of the original network for facial images and introduces residual modules and attention mechanisms, making the modified network model more suitable for facial expression multi classification recognition tasks. The recognition accuracy of the facial expression classification algorithm proposed by this work reaches 97.2%.