Deep fusion of symbolic and computational processing for next generation user interface

Abstract

We proposed the new design concept of the next generation user interface and developed a system, called RVI-desk, which provides with the intelligent user interface in which a user can communicate with the computing environment through multi modalities, such as voice, handwriting, pen gesture, printed material, touch screen and keyboard. Through the development of the system, we found that it was indispensable deeply to combine the symbolic and computational processing in order to realize a software architecture for the next generation user interface. Potentially the fuzzy methodologies play an important role to combine the symbolic and computational processing due to the inherent nature of fuzzy theory. The purpose of this paper is (i) to show that the next generation user interface is the attractive field for fuzzy methodologies, (ii) to clarify that the breakthrough is the deep fusion of the symbolic and computational processing, (iii) to introduce two leading systems we have developed as examples of the fusion of the symbolic and computational processing, and (iv) to appeal that further research is needed.