An interactive interface between human and computer based on pattern and speech recognition

Abstract

We present an interactive interface that uses the combination of speech and pattern as a new input modality to provide user-friendly access to computer. User can choose one of the color modules and put it anywhere then move the module to control the computer combines with speech commands. The interface is designed as a system that is based on pattern recognition and speech recognition; the general problem addressed in this work is that of pattern recognition in different illumination conditions and with various background colors. It's hard to choose a feature for pattern recognition. There's also problem of how to reduce false recognition rate when using speech recognition, and how to merge speech and pattern recognition together to control the moving of mouse, status of windows and starting or stopping a program. The paper focuses on implementation details and structure of the whole system to make it extensible and adaptable for various applications to be added to this system.