A Survey of Multimodal Human-Machine Interface

Abstract

Human-machine interface (HMI) has become an indispensable part of human life. The signal generated by human body is a kind of Physiological signal. There are many devices can recognize this signal, which has great potential as the input signal of HMI. Sometimes the HMI based on single-modality can not achieve the expected goal, more and more people begin to study multimodal HMI. In the past, many researchers have studied how to use these signals to control machine equipment, especially in the field of medical rehabilitation for the disabled, many achievements have been made, so that patients can exchange information with the outside world through HMI, and improve the quality of patients’ life. In this paper, the HMI and several physiological signals are introduced, and the research based on single modal HMI and multimodal HMI are investigated and analyzed. Finally, some problems existing in multimodal HMI are pointed out, and the future avenues of research in multimodal HMI is prospected.