Multimodal interface design based on synaesthesia effect

Abstract

Synaesthesia is the unique feeling resulting from the mutual responses of different kinds of human senses thus can enhance human ability to cognize information. The paper elaborated the concept of synaesthesia and introduced synaesthesia effect of human senses into human-machine interface design of product. By using multimodal interface based on synaesthesia human-machine interaction will become more natural and efficient. To provide a new method for multimodal interface design, the thesis explored the association between different information inputs from multiple channels and discussed the realization of multimodal human-machine interface design based on synaesthesia effect. The author also illustrated the application of this method in product interface design through a concept design of intelligent interface for household appliances.