Abstract
This paper presents an intelligent system allowing handicapped aphasiacs to perform basic communication tasks. It has the following three key features: (1) A 6-sensor data glove measures the finger gestures of a patient in terms of the bending degrees of his fingers. (2) A finger language recognition subsystem recognizes language components from the finger gestures. It employs multiple regression analysis to automatically extract proper finger features so that the recognition model can be fast and correctly constructed by a radial basis function neural network. (3) A coordinate-indexed virtual keyboard allows the users to directly access the letters on the keyboard at a practical speed. The system serves as a viable tool for natural and affordable communication for handicapped aphasiacs through continuous finger language input.
Highlights
Disabled people suffering from severe impairments usually face an acute problem: most common interaction modalities are unavailable and their communication capabilities are limited
The fact that the finger language designed for disabled aphasiacs involves only very tiny finger movements imposes very stringent requirements on both the software and hardware of any prospective systems
Important techniques involved in the recognition of finger language components are shown in Figure 2, including feature values calculation, feature selection and radial basis function neural network-based classification
Summary
Disabled people suffering from severe impairments usually face an acute problem: most common interaction modalities are unavailable and their communication capabilities are limited. It can be very frustrating for them to interact with the computer. They require and expect AAC (Augmentative and Alternative Communication) systems to partly alleviate physical limitations. AAC systems are usually equipped with special access mechanisms, since the users lack the fine motor-control required to operate such systems with standard peripheral devices. (c) The target users lack necessary motor control to operate associated peripherals. The objective of this work is to develop an intelligent and easy-to-use communication system (including proper hardware and software) that makes it possible for handicapped aphasiacs to perform basic communication tasks naturally and affordably
Talk to us
Join us for a 30 min session where you can share your feedback and ask us any queries you have